[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:32:44 dist-test-slave-1x4g krb5kdc[27462](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:32:44 dist-test-slave-1x4g krb5kdc[27462](info): set up 2 sockets
Aug 08 23:32:44 dist-test-slave-1x4g krb5kdc[27462](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 23:32:45.061658 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.006s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:32:45 dist-test-slave-1x4g krb5kdc[27462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231965, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:32:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:32:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:32:45.286572 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:36139
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:36139
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:32:45.825770 27477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:32:45.826202 27477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:32:45.826301 27477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:32:45.834082 27477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:32:45.834215 27477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:32:45.834264 27477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:32:45.834326 27477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:32:45.834372 27477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:32:45.846323 27477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:36139
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:36139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:32:45.848372 27477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:32:45.850452 27477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:32:45.872525 27482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:45.873281 27485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:45.873315 27483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:32:45.874537 27477 server_base.cc:1034] running on GCE node
I20260808 23:32:45.875973 27477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:32:45.878643 27477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:32:45.879947 27477 hybrid_clock.cc:648] HybridClock initialized: now 1786231965879859 us; error 89 us; skew 500 ppm
I20260808 23:32:45.880630 27477 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:32:45 dist-test-slave-1x4g krb5kdc[27462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231965, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:32:45.885589 27477 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:32:45.888386 27477 webserver.cc:460] Webserver started at http://127.26.207.254:41279/ using document root <none> and password file <none>
I20260808 23:32:45.889667 27477 fs_manager.cc:359] Metadata directory not provided
I20260808 23:32:45.889848 27477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:32:45.890377 27477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:32:45.895439 27477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "57b1c3b846684020b514492f1c303d63"
format_stamp: "Formatted at 2026-08-08 23:32:45 on dist-test-slave-1x4g"
server_key: "3094bf55be57562172951ac7c815ca18"
server_key_iv: "096f4d3f685616b9d73042e8371793f6"
server_key_version: "encryptionkey@0"
I20260808 23:32:45.896713 27477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "57b1c3b846684020b514492f1c303d63"
format_stamp: "Formatted at 2026-08-08 23:32:45 on dist-test-slave-1x4g"
server_key: "3094bf55be57562172951ac7c815ca18"
server_key_iv: "096f4d3f685616b9d73042e8371793f6"
server_key_version: "encryptionkey@0"
I20260808 23:32:45.906105 27477 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.002s sys 0.005s
I20260808 23:32:45.912377 27492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:45.914757 27477 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260808 23:32:45.915102 27477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "57b1c3b846684020b514492f1c303d63"
format_stamp: "Formatted at 2026-08-08 23:32:45 on dist-test-slave-1x4g"
server_key: "3094bf55be57562172951ac7c815ca18"
server_key_iv: "096f4d3f685616b9d73042e8371793f6"
server_key_version: "encryptionkey@0"
I20260808 23:32:45.915367 27477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:32:45.945133 27477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:32:45.950949 27477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:32:45.951378 27477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:32:45.984014 27477 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:36139
I20260808 23:32:45.984082 27545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:36139 every 8 connection(s)
I20260808 23:32:45.987504 27477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:32:45.995846 27546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:32:45.997212 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 27477
I20260808 23:32:45.997844 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:32:46.001700 27455 external_mini_cluster.cc:1428] Setting key 1abe957f947d7c0b58bf30ede23fe032
I20260808 23:32:46.022344 27546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63: Bootstrap starting.
I20260808 23:32:46.030521 27546 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63: Neither blocks nor log segments found. Creating new log.
I20260808 23:32:46.032953 27546 log.cc:824] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63: Log is configured to *not* fsync() on all Append() calls
I20260808 23:32:46.038516 27546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63: No bootstrap required, opened a new log
Aug 08 23:32:46 dist-test-slave-1x4g krb5kdc[27462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231965, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:32:46.054370 27546 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b1c3b846684020b514492f1c303d63" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36139 } }
I20260808 23:32:46.055034 27546 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:32:46.055249 27546 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57b1c3b846684020b514492f1c303d63, State: Initialized, Role: FOLLOWER
I20260808 23:32:46.056529 27546 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b1c3b846684020b514492f1c303d63" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36139 } }
I20260808 23:32:46.057120 27546 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:32:46.057494 27546 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:32:46.057870 27546 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:32:46.061481 27546 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b1c3b846684020b514492f1c303d63" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36139 } }
I20260808 23:32:46.062786 27546 leader_election.cc:302] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57b1c3b846684020b514492f1c303d63; no voters:
I20260808 23:32:46.064079 27546 leader_election.cc:288] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:32:46.064425 27552 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:32:46.066289 27552 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [term 1 LEADER]: Becoming Leader. State: Replica: 57b1c3b846684020b514492f1c303d63, State: Running, Role: LEADER
I20260808 23:32:46.066963 27549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:46.011623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42804 (local address 127.26.207.254:36139)
0808 23:32:46.014019 (+ 2396us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:46.014032 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:46.014083 (+ 51us) server_negotiation.cc:407] Connection header received
0808 23:32:46.030514 (+ 16431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:46.030545 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:46.031315 (+ 770us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:46.031801 (+ 486us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:46.037143 (+ 5342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:46.038943 (+ 1800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:46.042635 (+ 3692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:46.043679 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:46.043959 (+ 280us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:46.053858 (+ 9899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:46.053922 (+ 64us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:46.053961 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:46.054021 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:46.059089 (+ 5068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:46.060211 (+ 1122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:46.060218 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:46.060224 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:46.060499 (+ 275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:46.061177 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:46.061184 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:46.061192 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:46.062148 (+ 956us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:46.062690 (+ 542us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:46.063804 (+ 1114us) server_negotiation.cc:299] Negotiation successful
0808 23:32:46.064368 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1991,"thread_start_us":1581,"threads_started":1}
I20260808 23:32:46.067484 27552 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b1c3b846684020b514492f1c303d63" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36139 } }
I20260808 23:32:46.070592 27546 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:32:46.076361 27553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57b1c3b846684020b514492f1c303d63. Latest consensus state: current_term: 1 leader_uuid: "57b1c3b846684020b514492f1c303d63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b1c3b846684020b514492f1c303d63" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36139 } } }
I20260808 23:32:46.076388 27554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57b1c3b846684020b514492f1c303d63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b1c3b846684020b514492f1c303d63" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36139 } } }
I20260808 23:32:46.078096 27553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [sys.catalog]: This master's current role is: LEADER
I20260808 23:32:46.078210 27554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63 [sys.catalog]: This master's current role is: LEADER
I20260808 23:32:46.083441 27561 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:32:46.094143 27561 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:32:46.110821 27561 catalog_manager.cc:1347] Generated new cluster ID: a713200151bd46d5be21cc6f488216d6
I20260808 23:32:46.111021 27561 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:32:46.156656 27561 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:32:46.159017 27561 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:32:46.178445 27561 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57b1c3b846684020b514492f1c303d63: Generated new TSK 0
I20260808 23:32:46.179986 27561 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:32:46.237869 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36139
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:32:46.702718 27574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:32:46.703056 27574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:32:46.703171 27574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:32:46.712827 27574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:32:46.713088 27574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:32:46.713232 27574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:32:46.725570 27574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36139
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:32:46.726969 27574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:32:46.728461 27574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:32:46.747216 27579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:46.747151 27580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:46.747167 27582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:32:46.750761 27574 server_base.cc:1034] running on GCE node
I20260808 23:32:46.751547 27574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:32:46.752673 27574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:32:46.754089 27574 hybrid_clock.cc:648] HybridClock initialized: now 1786231966753889 us; error 41 us; skew 500 ppm
I20260808 23:32:46.754642 27574 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:32:46 dist-test-slave-1x4g krb5kdc[27462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231966, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:32:46.759243 27574 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:32:46.761576 27574 webserver.cc:460] Webserver started at http://127.26.207.193:39285/ using document root <none> and password file <none>
I20260808 23:32:46.762622 27574 fs_manager.cc:359] Metadata directory not provided
I20260808 23:32:46.762861 27574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:32:46.763285 27574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:32:46.766781 27574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "839e60632f014fe3b272dd42c62a2d77"
format_stamp: "Formatted at 2026-08-08 23:32:46 on dist-test-slave-1x4g"
server_key: "f10c16a510cb14f0ff9ceee80d2e4732"
server_key_iv: "7a82d9e87aa98d5322b487ccba8a77eb"
server_key_version: "encryptionkey@0"
I20260808 23:32:46.767870 27574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "839e60632f014fe3b272dd42c62a2d77"
format_stamp: "Formatted at 2026-08-08 23:32:46 on dist-test-slave-1x4g"
server_key: "f10c16a510cb14f0ff9ceee80d2e4732"
server_key_iv: "7a82d9e87aa98d5322b487ccba8a77eb"
server_key_version: "encryptionkey@0"
I20260808 23:32:46.775058 27574 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260808 23:32:46.779920 27589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:46.781766 27574 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:32:46.782027 27574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "839e60632f014fe3b272dd42c62a2d77"
format_stamp: "Formatted at 2026-08-08 23:32:46 on dist-test-slave-1x4g"
server_key: "f10c16a510cb14f0ff9ceee80d2e4732"
server_key_iv: "7a82d9e87aa98d5322b487ccba8a77eb"
server_key_version: "encryptionkey@0"
I20260808 23:32:46.782302 27574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:32:46.801930 27574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:32:46.808233 27574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:32:46.808609 27574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:32:46.809969 27574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:32:46.812129 27574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:32:46.812258 27574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:46.812496 27574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:32:46.812629 27574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:46.870888 27574 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:35663
I20260808 23:32:46.870926 27708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:35663 every 8 connection(s)
I20260808 23:32:46.872560 27574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:32:46.875263 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 27574
I20260808 23:32:46.875626 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:32:46.876353 27455 external_mini_cluster.cc:1428] Setting key db263c8f3ae13edad5b6c4c227046d18
Aug 08 23:32:46 dist-test-slave-1x4g krb5kdc[27462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231966, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
I20260808 23:32:46.902668 27711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:46.876636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:47007 (local address 127.26.207.254:36139)
0808 23:32:46.877382 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:46.877389 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:46.879628 (+ 2239us) server_negotiation.cc:407] Connection header received
0808 23:32:46.882398 (+ 2770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:46.882415 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:46.882618 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:46.882845 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:46.885103 (+ 2258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:46.886512 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:46.889523 (+ 3011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:46.890007 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:46.890200 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:46.895362 (+ 5162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:46.895371 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:46.895375 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:46.895421 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:46.898661 (+ 3240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:46.899694 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:46.899699 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:46.899701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:46.899860 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:46.900400 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:46.900404 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:46.900406 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:46.900715 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:46.900932 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:46.901867 (+ 935us) server_negotiation.cc:299] Negotiation successful
0808 23:32:46.902204 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":362,"threads_started":1}
I20260808 23:32:46.903870 27712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:46.877856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36139 (local address 127.26.207.193:47007)
0808 23:32:46.879416 (+ 1560us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:46.879483 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:46.881996 (+ 2513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:46.883082 (+ 1086us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:46.883091 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:46.883833 (+ 742us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:32:46.884821 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:46.884861 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:46.886815 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:46.886820 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:46.889277 (+ 2457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:46.889299 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:46.890438 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:46.890449 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:46.890826 (+ 377us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:46.891850 (+ 1024us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:32:46.891880 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:32:46.894999 (+ 3119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:32:46.898925 (+ 3926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:46.898935 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:46.898954 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:46.899507 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:46.899999 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:46.900007 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:46.900015 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:46.900247 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:46.900909 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:32:46.900918 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:32:46.901335 (+ 417us) client_negotiation.cc:769] Sending connection context
0808 23:32:46.901728 (+ 393us) client_negotiation.cc:240] Negotiation successful
0808 23:32:46.902361 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1175,"thread_start_us":846,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
I20260808 23:32:46.906111 27709 heartbeater.cc:347] Connected to a master server at 127.26.207.254:36139
I20260808 23:32:46.906626 27709 heartbeater.cc:464] Registering TS with master...
I20260808 23:32:46.907799 27709 heartbeater.cc:511] Master 127.26.207.254:36139 requested a full tablet report, sending...
I20260808 23:32:46.913662 27510 ts_manager.cc:194] Registered new tserver with Master: 839e60632f014fe3b272dd42c62a2d77 (127.26.207.193:35663)
I20260808 23:32:46.916085 27510 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:47007
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:32:46.934122 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36139
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:32:47.402138 27715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:32:47.402480 27715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:32:47.402587 27715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:32:47.411049 27715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:32:47.411262 27715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:32:47.411489 27715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:32:47.423779 27715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36139
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:32:47.425393 27715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:32:47.427286 27715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:32:47.444061 27720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:47.444070 27723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:47.444635 27721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:32:47.446444 27715 server_base.cc:1034] running on GCE node
I20260808 23:32:47.447161 27715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:32:47.448362 27715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:32:47.449602 27715 hybrid_clock.cc:648] HybridClock initialized: now 1786231967449554 us; error 48 us; skew 500 ppm
I20260808 23:32:47.449980 27715 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:32:47 dist-test-slave-1x4g krb5kdc[27462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231967, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:32:47.459543 27715 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:32:47.461634 27715 webserver.cc:460] Webserver started at http://127.26.207.194:33685/ using document root <none> and password file <none>
I20260808 23:32:47.462631 27715 fs_manager.cc:359] Metadata directory not provided
I20260808 23:32:47.462848 27715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:32:47.463282 27715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:32:47.466883 27715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "ddd2b1f0a337421eb0cce60ed748a638"
format_stamp: "Formatted at 2026-08-08 23:32:47 on dist-test-slave-1x4g"
server_key: "1fca0813e86890574923e75d4159048b"
server_key_iv: "32f3f229238785705b60ac996429a4c0"
server_key_version: "encryptionkey@0"
I20260808 23:32:47.467931 27715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "ddd2b1f0a337421eb0cce60ed748a638"
format_stamp: "Formatted at 2026-08-08 23:32:47 on dist-test-slave-1x4g"
server_key: "1fca0813e86890574923e75d4159048b"
server_key_iv: "32f3f229238785705b60ac996429a4c0"
server_key_version: "encryptionkey@0"
I20260808 23:32:47.475443 27715 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260808 23:32:47.479950 27730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:47.481776 27715 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 23:32:47.482033 27715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "ddd2b1f0a337421eb0cce60ed748a638"
format_stamp: "Formatted at 2026-08-08 23:32:47 on dist-test-slave-1x4g"
server_key: "1fca0813e86890574923e75d4159048b"
server_key_iv: "32f3f229238785705b60ac996429a4c0"
server_key_version: "encryptionkey@0"
I20260808 23:32:47.482303 27715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:32:47.503400 27715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:32:47.509550 27715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:32:47.510051 27715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:32:47.511534 27715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:32:47.513736 27715 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:32:47.513862 27715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:47.514012 27715 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:32:47.514083 27715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:47.579377 27715 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:46037
I20260808 23:32:47.579414 27849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:46037 every 8 connection(s)
I20260808 23:32:47.581095 27715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:32:47.582348 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 27715
I20260808 23:32:47.582618 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:32:47.583333 27455 external_mini_cluster.cc:1428] Setting key 35e02239c242ba7d6309cd776b732ea1
Aug 08 23:32:47 dist-test-slave-1x4g krb5kdc[27462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231967, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
I20260808 23:32:47.607280 27852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:47.584719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:51563 (local address 127.26.207.254:36139)
0808 23:32:47.585290 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:47.585297 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:47.586947 (+ 1650us) server_negotiation.cc:407] Connection header received
0808 23:32:47.589824 (+ 2877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:47.589830 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:47.589938 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:47.590180 (+ 242us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:47.592029 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:47.592762 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:47.594721 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:47.595181 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:47.595333 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:47.600157 (+ 4824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:47.600162 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:47.600166 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:47.600207 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:47.603361 (+ 3154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:47.604320 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:47.604330 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:47.604333 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:47.604476 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:47.605044 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:47.605049 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:47.605054 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:47.605420 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:47.605587 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:47.606396 (+ 809us) server_negotiation.cc:299] Negotiation successful
0808 23:32:47.606667 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":255,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
I20260808 23:32:47.608520 27853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:47.585576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36139 (local address 127.26.207.194:51563)
0808 23:32:47.586731 (+ 1155us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:47.586804 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:47.589465 (+ 2661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:47.590481 (+ 1016us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:47.590492 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:47.591118 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:32:47.591800 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:47.591822 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:47.593047 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:47.593051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:47.594536 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:47.594551 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:47.595445 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:47.595453 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:47.595716 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:47.596565 (+ 849us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:32:47.596592 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:32:47.599780 (+ 3188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:32:47.603607 (+ 3827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:47.603617 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:47.603634 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:47.604154 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:47.604611 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:47.604623 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:47.604625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:47.604914 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:47.605566 (+ 652us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:32:47.605576 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:32:47.605984 (+ 408us) client_negotiation.cc:769] Sending connection context
0808 23:32:47.606287 (+ 303us) client_negotiation.cc:240] Negotiation successful
0808 23:32:47.607026 (+ 739us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":786,"thread_start_us":464,"threads_started":1}
I20260808 23:32:47.610428 27850 heartbeater.cc:347] Connected to a master server at 127.26.207.254:36139
I20260808 23:32:47.610816 27850 heartbeater.cc:464] Registering TS with master...
I20260808 23:32:47.611979 27850 heartbeater.cc:511] Master 127.26.207.254:36139 requested a full tablet report, sending...
I20260808 23:32:47.613812 27510 ts_manager.cc:194] Registered new tserver with Master: ddd2b1f0a337421eb0cce60ed748a638 (127.26.207.194:46037)
I20260808 23:32:47.614737 27510 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:51563
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:32:47.638115 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36139
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:32:47.920894 27709 heartbeater.cc:503] Master 127.26.207.254:36139 was elected leader, sending a full tablet report...
W20260808 23:32:48.063730 27857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:32:48.064056 27857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:32:48.064162 27857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:32:48.071869 27857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:32:48.072002 27857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:32:48.072216 27857 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:32:48.083246 27857 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36139
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:32:48.085091 27857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:32:48.086663 27857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:32:48.102707 27865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:48.102843 27862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:48.102843 27863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:32:48.104017 27857 server_base.cc:1034] running on GCE node
I20260808 23:32:48.104827 27857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:32:48.106046 27857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:32:48.107323 27857 hybrid_clock.cc:648] HybridClock initialized: now 1786231968107248 us; error 39 us; skew 500 ppm
I20260808 23:32:48.107715 27857 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:32:48 dist-test-slave-1x4g krb5kdc[27462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231968, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:32:48.111536 27857 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:32:48.113348 27857 webserver.cc:460] Webserver started at http://127.26.207.195:40043/ using document root <none> and password file <none>
I20260808 23:32:48.114099 27857 fs_manager.cc:359] Metadata directory not provided
I20260808 23:32:48.114215 27857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:32:48.114605 27857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:32:48.117992 27857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "bbaebea5592a456bbf93bce86ec97e1a"
format_stamp: "Formatted at 2026-08-08 23:32:48 on dist-test-slave-1x4g"
server_key: "f4957205478d3ea86304b30aa430214b"
server_key_iv: "997f4bea2cfe7b3f181901a9b67b18d0"
server_key_version: "encryptionkey@0"
I20260808 23:32:48.118940 27857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "bbaebea5592a456bbf93bce86ec97e1a"
format_stamp: "Formatted at 2026-08-08 23:32:48 on dist-test-slave-1x4g"
server_key: "f4957205478d3ea86304b30aa430214b"
server_key_iv: "997f4bea2cfe7b3f181901a9b67b18d0"
server_key_version: "encryptionkey@0"
I20260808 23:32:48.125839 27857 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 23:32:48.130211 27874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:48.131974 27857 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 23:32:48.132231 27857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "bbaebea5592a456bbf93bce86ec97e1a"
format_stamp: "Formatted at 2026-08-08 23:32:48 on dist-test-slave-1x4g"
server_key: "f4957205478d3ea86304b30aa430214b"
server_key_iv: "997f4bea2cfe7b3f181901a9b67b18d0"
server_key_version: "encryptionkey@0"
I20260808 23:32:48.132485 27857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:32:48.150425 27857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:32:48.155655 27857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:32:48.156016 27857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:32:48.157183 27857 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:32:48.158814 27857 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:32:48.158897 27857 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:48.159080 27857 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:32:48.159134 27857 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:48.212569 27857 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:42497
I20260808 23:32:48.212698 27989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:42497 every 8 connection(s)
I20260808 23:32:48.214504 27857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:32:48.223603 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 27857
I20260808 23:32:48.223938 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:32:48.224818 27455 external_mini_cluster.cc:1428] Setting key debf582f6da71482492e99208e1a0b61
Aug 08 23:32:48 dist-test-slave-1x4g krb5kdc[27462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231968, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:32:48.243358 27992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:48.218628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:59883 (local address 127.26.207.254:36139)
0808 23:32:48.219470 (+ 842us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:48.219476 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:48.221045 (+ 1569us) server_negotiation.cc:407] Connection header received
0808 23:32:48.223508 (+ 2463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:48.223515 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:48.223631 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:48.223886 (+ 255us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:48.226798 (+ 2912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:48.227900 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:48.230659 (+ 2759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:48.231202 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:48.231317 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:48.235297 (+ 3980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:48.235303 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:48.235306 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:48.235343 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:48.239298 (+ 3955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:48.240257 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:48.240261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:48.240264 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:48.240411 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:48.240952 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:48.240960 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:48.240963 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:48.241331 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:48.241551 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:48.242694 (+ 1143us) server_negotiation.cc:299] Negotiation successful
0808 23:32:48.242943 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":561,"threads_started":1}
I20260808 23:32:48.244561 27993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:48.219230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36139 (local address 127.26.207.195:59883)
0808 23:32:48.220851 (+ 1621us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:48.220910 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:48.223131 (+ 2221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:48.224352 (+ 1221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:48.224368 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:48.225685 (+ 1317us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:32:48.226562 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:48.226596 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:48.228137 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:48.228143 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:48.230490 (+ 2347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:48.230508 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:48.231455 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:48.231461 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:48.231687 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:48.232424 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:32:48.232452 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:32:48.235037 (+ 2585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:32:48.239499 (+ 4462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:48.239508 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:48.239524 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:48.240113 (+ 589us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:48.240528 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:48.240531 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:48.240534 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:48.240738 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:48.241466 (+ 728us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:32:48.241473 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:32:48.242073 (+ 600us) client_negotiation.cc:769] Sending connection context
0808 23:32:48.242406 (+ 333us) client_negotiation.cc:240] Negotiation successful
0808 23:32:48.243005 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1078,"thread_start_us":651,"threads_started":1}
I20260808 23:32:48.246415 27990 heartbeater.cc:347] Connected to a master server at 127.26.207.254:36139
I20260808 23:32:48.246780 27990 heartbeater.cc:464] Registering TS with master...
I20260808 23:32:48.247651 27990 heartbeater.cc:511] Master 127.26.207.254:36139 requested a full tablet report, sending...
I20260808 23:32:48.249578 27510 ts_manager.cc:194] Registered new tserver with Master: bbaebea5592a456bbf93bce86ec97e1a (127.26.207.195:42497)
I20260808 23:32:48.250646 27510 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:59883
I20260808 23:32:48.256767 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 23:32:48 dist-test-slave-1x4g krb5kdc[27462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231968, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 23:32:48 dist-test-slave-1x4g krb5kdc[27462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231968, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:32:48.319712 27998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:48.300199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57592 (local address 127.26.207.193:35663)
0808 23:32:48.301078 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:48.301086 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:48.301115 (+ 29us) server_negotiation.cc:407] Connection header received
0808 23:32:48.301179 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:48.301186 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:48.301441 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:48.301585 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:48.303491 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:48.304654 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:48.306283 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:48.307015 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:48.307150 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:48.312105 (+ 4955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:48.312124 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:48.312142 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:48.312195 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:48.315915 (+ 3720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:48.317007 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:48.317016 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:48.317018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:48.317214 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:48.317837 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:48.317842 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:48.317844 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:48.318321 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:48.318736 (+ 415us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:48.319029 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 23:32:48.319288 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":475,"threads_started":1}
W20260808 23:32:48.321707 27618 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57592
Aug 08 23:32:48 dist-test-slave-1x4g krb5kdc[27462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 23:32:48 dist-test-slave-1x4g krb5kdc[27462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:32:48.379571 27998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:48.363038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57604 (local address 127.26.207.193:35663)
0808 23:32:48.363273 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:48.363280 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:48.363425 (+ 145us) server_negotiation.cc:407] Connection header received
0808 23:32:48.363672 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:48.363676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:48.363748 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:48.363861 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:48.365433 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:48.366180 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:48.367573 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:48.368061 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:48.368211 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:48.372939 (+ 4728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:48.372945 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:48.372948 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:48.372989 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:48.376226 (+ 3237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:48.377253 (+ 1027us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:48.377262 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:48.377271 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:48.377447 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:48.377917 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:48.377921 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:48.377924 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:48.378227 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:48.378524 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:48.378899 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 23:32:48.379191 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 23:32:48.381886 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 27574
I20260808 23:32:48.397415 27998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:48.383167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57616 (local address 127.26.207.193:35663)
0808 23:32:48.383519 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:48.383528 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:48.383855 (+ 327us) server_negotiation.cc:407] Connection header received
0808 23:32:48.384135 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:48.384140 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:48.384209 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:48.384300 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:48.385761 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:48.386647 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:48.388143 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:48.388685 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:48.388900 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:48.391456 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:48.391462 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:48.391465 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:48.391505 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:48.394248 (+ 2743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:48.395093 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:48.395099 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:48.395110 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:48.395268 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:48.395720 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:48.395726 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:48.395730 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:48.396055 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:48.396340 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:48.396677 (+ 337us) server_negotiation.cc:299] Negotiation successful
0808 23:32:48.396981 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 23:32:48.398341 27702 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:32:48.490362 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 27574
I20260808 23:32:48.511989 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 27715
Aug 08 23:32:48 dist-test-slave-1x4g krb5kdc[27462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:32:48.530184 28006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:48.512983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38894 (local address 127.26.207.194:46037)
0808 23:32:48.513589 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:48.513596 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:48.513625 (+ 29us) server_negotiation.cc:407] Connection header received
0808 23:32:48.513695 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:48.513702 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:48.514101 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:48.514276 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:48.515609 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:48.516678 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:48.518158 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:48.518752 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:48.518864 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:48.523603 (+ 4739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:48.523620 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:48.523638 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:48.523686 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:48.527099 (+ 3413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:48.527924 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:48.527932 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:48.527935 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:48.528075 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:48.528489 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:48.528492 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:48.528495 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:48.528965 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:48.529220 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:48.529615 (+ 395us) server_negotiation.cc:299] Negotiation successful
0808 23:32:48.529859 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":315,"threads_started":1}
I20260808 23:32:48.531702 27845 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:32:48.618068 27850 heartbeater.cc:503] Master 127.26.207.254:36139 was elected leader, sending a full tablet report...
I20260808 23:32:48.618953 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 27715
W20260808 23:32:48.641076 27495 connection.cc:535] server connection from 127.26.207.194:51563 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 23:32:48.641503 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 27857
Aug 08 23:32:48 dist-test-slave-1x4g krb5kdc[27462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:32:48.670467 28008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:48.642487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37924 (local address 127.26.207.195:42497)
0808 23:32:48.643115 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:48.643123 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:48.643159 (+ 36us) server_negotiation.cc:407] Connection header received
0808 23:32:48.643230 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:48.643237 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:48.643477 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:48.643626 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:48.645647 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:48.647758 (+ 2111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:48.650960 (+ 3202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:48.652366 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:48.653619 (+ 1253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:48.659940 (+ 6321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:48.659958 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:48.659979 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:48.660036 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:48.665569 (+ 5533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:48.666564 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:48.666577 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:48.666583 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:48.666796 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:48.667354 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:48.667362 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:48.667367 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:48.668162 (+ 795us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:48.668860 (+ 698us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:48.669179 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 23:32:48.669670 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":292,"threads_started":1}
I20260808 23:32:48.672231 27985 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:32:48.759001 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 27857
I20260808 23:32:48.781239 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 27477
I20260808 23:32:48.782513 27541 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:32:48.896062 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 27477
2026-08-08T23:32:48Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (5021 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:32:49 dist-test-slave-1x4g krb5kdc[28013](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:32:49 dist-test-slave-1x4g krb5kdc[28013](info): set up 2 sockets
Aug 08 23:32:49 dist-test-slave-1x4g krb5kdc[28013](info): commencing operation
krb5kdc: starting...
W20260808 23:32:50.069265 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.004s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:32:50 dist-test-slave-1x4g krb5kdc[28013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231970, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:32:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:32:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:32:50.298604 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:38227
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:44977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:38227
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:32:50.667984 28028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:32:50.668339 28028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:32:50.668437 28028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:32:50.676268 28028 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:32:50.676416 28028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:32:50.676468 28028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:32:50.676520 28028 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:32:50.676566 28028 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:32:50.687229 28028 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:38227
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:38227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:32:50.688707 28028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:32:50.690191 28028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:32:50.703406 28033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:50.703492 28034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:50.705010 28036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:32:50.707137 28028 server_base.cc:1034] running on GCE node
I20260808 23:32:50.708137 28028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:32:50.709935 28028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:32:50.711174 28028 hybrid_clock.cc:648] HybridClock initialized: now 1786231970711118 us; error 51 us; skew 500 ppm
I20260808 23:32:50.711548 28028 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:32:50 dist-test-slave-1x4g krb5kdc[28013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231970, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:32:50.715039 28028 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:32:50.716763 28028 webserver.cc:460] Webserver started at http://127.26.207.254:37407/ using document root <none> and password file <none>
I20260808 23:32:50.717590 28028 fs_manager.cc:359] Metadata directory not provided
I20260808 23:32:50.717705 28028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:32:50.718006 28028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:32:50.721505 28028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "169d4a6388e74f57a716aa898953669b"
format_stamp: "Formatted at 2026-08-08 23:32:50 on dist-test-slave-1x4g"
server_key: "80bc3c30a1228c6d8f0bc899725d4bd0"
server_key_iv: "661ecd86016dcc14fcccc35bebacf949"
server_key_version: "encryptionkey@0"
I20260808 23:32:50.722357 28028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "169d4a6388e74f57a716aa898953669b"
format_stamp: "Formatted at 2026-08-08 23:32:50 on dist-test-slave-1x4g"
server_key: "80bc3c30a1228c6d8f0bc899725d4bd0"
server_key_iv: "661ecd86016dcc14fcccc35bebacf949"
server_key_version: "encryptionkey@0"
I20260808 23:32:50.728861 28028 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 23:32:50.732930 28043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:50.734579 28028 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 23:32:50.734771 28028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "169d4a6388e74f57a716aa898953669b"
format_stamp: "Formatted at 2026-08-08 23:32:50 on dist-test-slave-1x4g"
server_key: "80bc3c30a1228c6d8f0bc899725d4bd0"
server_key_iv: "661ecd86016dcc14fcccc35bebacf949"
server_key_version: "encryptionkey@0"
I20260808 23:32:50.735082 28028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:32:50.754354 28028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:32:50.759074 28028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:32:50.759364 28028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:32:50.780331 28028 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:38227
I20260808 23:32:50.780339 28094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:38227 every 8 connection(s)
I20260808 23:32:50.782037 28028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:32:50.784296 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 28028
I20260808 23:32:50.784543 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:32:50.785283 27455 external_mini_cluster.cc:1428] Setting key aa96161a8b08a647a521e2b3587761fa
I20260808 23:32:50.786681 28096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 23:32:50 dist-test-slave-1x4g krb5kdc[28013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231970, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:32:50.800369 28096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b: Bootstrap starting.
I20260808 23:32:50.804401 28096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b: Neither blocks nor log segments found. Creating new log.
I20260808 23:32:50.805733 28096 log.cc:824] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b: Log is configured to *not* fsync() on all Append() calls
I20260808 23:32:50.809113 28096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b: No bootstrap required, opened a new log
I20260808 23:32:50.810190 28099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:50.787334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56608 (local address 127.26.207.254:38227)
0808 23:32:50.788280 (+ 946us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:50.788299 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:50.788694 (+ 395us) server_negotiation.cc:407] Connection header received
0808 23:32:50.790577 (+ 1883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:50.790604 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:50.791033 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:50.791482 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:50.793206 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:50.794567 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:50.795908 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:50.796718 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:50.797060 (+ 342us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:50.801732 (+ 4672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:50.801741 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:50.801757 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:50.801808 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:50.805359 (+ 3551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:50.806325 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:50.806334 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:50.806341 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:50.806554 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:50.807013 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:50.807021 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:50.807023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:50.807670 (+ 647us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:50.808024 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:50.808549 (+ 525us) server_negotiation.cc:299] Negotiation successful
0808 23:32:50.809048 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":645,"thread_start_us":416,"threads_started":1}
I20260808 23:32:50.817823 28096 raft_consensus.cc:348] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "169d4a6388e74f57a716aa898953669b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38227 } }
I20260808 23:32:50.818413 28096 raft_consensus.cc:374] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:32:50.818557 28096 raft_consensus.cc:729] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169d4a6388e74f57a716aa898953669b, State: Initialized, Role: FOLLOWER
I20260808 23:32:50.819206 28096 consensus_queue.cc:260] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "169d4a6388e74f57a716aa898953669b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38227 } }
I20260808 23:32:50.819492 28096 raft_consensus.cc:388] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:32:50.819639 28096 raft_consensus.cc:482] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:32:50.819829 28096 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:32:50.822711 28096 raft_consensus.cc:504] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "169d4a6388e74f57a716aa898953669b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38227 } }
I20260808 23:32:50.823252 28096 leader_election.cc:302] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 169d4a6388e74f57a716aa898953669b; no voters:
I20260808 23:32:50.823830 28096 leader_election.cc:288] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:32:50.823990 28101 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:32:50.824718 28101 raft_consensus.cc:686] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [term 1 LEADER]: Becoming Leader. State: Replica: 169d4a6388e74f57a716aa898953669b, State: Running, Role: LEADER
I20260808 23:32:50.825304 28101 consensus_queue.cc:237] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "169d4a6388e74f57a716aa898953669b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38227 } }
I20260808 23:32:50.826116 28096 sys_catalog.cc:564] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:32:50.828924 28102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "169d4a6388e74f57a716aa898953669b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "169d4a6388e74f57a716aa898953669b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38227 } } }
I20260808 23:32:50.829650 28102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [sys.catalog]: This master's current role is: LEADER
I20260808 23:32:50.839439 28103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 169d4a6388e74f57a716aa898953669b. Latest consensus state: current_term: 1 leader_uuid: "169d4a6388e74f57a716aa898953669b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "169d4a6388e74f57a716aa898953669b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38227 } } }
I20260808 23:32:50.839771 28103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b [sys.catalog]: This master's current role is: LEADER
I20260808 23:32:50.840560 28106 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:32:50.846657 28106 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:32:50.857384 28106 catalog_manager.cc:1347] Generated new cluster ID: 2cb589a5302045518591458b30f987c6
I20260808 23:32:50.857553 28106 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:32:50.868618 28106 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:32:50.870760 28106 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:32:50.883802 28106 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 169d4a6388e74f57a716aa898953669b: Generated new TSK 0
I20260808 23:32:50.884872 28106 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:32:50.952857 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38227
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:44977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:32:51.329316 28124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:32:51.329650 28124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:32:51.329819 28124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:32:51.337697 28124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:32:51.337867 28124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:32:51.338052 28124 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:32:51.348994 28124 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38227
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:32:51.350472 28124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:32:51.351927 28124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:32:51.366413 28130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:51.366420 28132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:51.367192 28129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:32:51.367678 28124 server_base.cc:1034] running on GCE node
I20260808 23:32:51.368400 28124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:32:51.369558 28124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:32:51.370806 28124 hybrid_clock.cc:648] HybridClock initialized: now 1786231971370756 us; error 47 us; skew 500 ppm
I20260808 23:32:51.371181 28124 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:32:51 dist-test-slave-1x4g krb5kdc[28013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231971, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:32:51.374965 28124 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:32:51.376675 28124 webserver.cc:460] Webserver started at http://127.26.207.193:38531/ using document root <none> and password file <none>
I20260808 23:32:51.377600 28124 fs_manager.cc:359] Metadata directory not provided
I20260808 23:32:51.377760 28124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:32:51.378118 28124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:32:51.381791 28124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "970173bfbe224ffeafa3eccfd90c1715"
format_stamp: "Formatted at 2026-08-08 23:32:51 on dist-test-slave-1x4g"
server_key: "5a175ffd3a6a2448adbd0770178ad29f"
server_key_iv: "d9c3162708b8d6896ff44c5951fe2265"
server_key_version: "encryptionkey@0"
I20260808 23:32:51.382997 28124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "970173bfbe224ffeafa3eccfd90c1715"
format_stamp: "Formatted at 2026-08-08 23:32:51 on dist-test-slave-1x4g"
server_key: "5a175ffd3a6a2448adbd0770178ad29f"
server_key_iv: "d9c3162708b8d6896ff44c5951fe2265"
server_key_version: "encryptionkey@0"
I20260808 23:32:51.389242 28124 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 23:32:51.393409 28139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:51.395066 28124 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 23:32:51.395306 28124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "970173bfbe224ffeafa3eccfd90c1715"
format_stamp: "Formatted at 2026-08-08 23:32:51 on dist-test-slave-1x4g"
server_key: "5a175ffd3a6a2448adbd0770178ad29f"
server_key_iv: "d9c3162708b8d6896ff44c5951fe2265"
server_key_version: "encryptionkey@0"
I20260808 23:32:51.395578 28124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:32:51.412760 28124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:32:51.417572 28124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:32:51.417912 28124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:32:51.419114 28124 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:32:51.420655 28124 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:32:51.420771 28124 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:51.420979 28124 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:32:51.421059 28124 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:51.457674 28124 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:34711
I20260808 23:32:51.457768 28257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:34711 every 8 connection(s)
I20260808 23:32:51.459100 28124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:32:51.459597 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 28124
I20260808 23:32:51.459857 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:32:51.460824 27455 external_mini_cluster.cc:1428] Setting key 703d75d710400e6287972d5a3da0f8b5
Aug 08 23:32:51 dist-test-slave-1x4g krb5kdc[28013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231971, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
I20260808 23:32:51.483394 28261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:51.462160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:60407 (local address 127.26.207.254:38227)
0808 23:32:51.462714 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:51.462721 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:51.464110 (+ 1389us) server_negotiation.cc:407] Connection header received
0808 23:32:51.466370 (+ 2260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:51.466380 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:51.466501 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:51.466635 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:51.468471 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:51.469650 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:51.471406 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:51.471843 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:51.472003 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:51.476615 (+ 4612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:51.476622 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:51.476625 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:51.476666 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:51.479672 (+ 3006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:51.480661 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:51.480673 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:51.480677 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:51.480876 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:51.481371 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:51.481377 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:51.481381 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:51.481735 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:51.481889 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:51.482735 (+ 846us) server_negotiation.cc:299] Negotiation successful
0808 23:32:51.483008 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":284,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
I20260808 23:32:51.484663 28262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:51.462860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:38227 (local address 127.26.207.193:60407)
0808 23:32:51.463875 (+ 1015us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:51.463944 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:51.466020 (+ 2076us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:51.466952 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:51.466961 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:51.467572 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:32:51.468247 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:51.468267 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:51.469866 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:51.469871 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:51.471227 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:51.471242 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:51.472132 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:51.472140 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:51.472419 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:51.473297 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:32:51.473323 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:32:51.476285 (+ 2962us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:32:51.479895 (+ 3610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:51.479906 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:51.479928 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:51.480507 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:51.481011 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:51.481017 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:51.481021 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:51.481246 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:51.481880 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:32:51.481890 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:32:51.482296 (+ 406us) client_negotiation.cc:769] Sending connection context
0808 23:32:51.482601 (+ 305us) client_negotiation.cc:240] Negotiation successful
0808 23:32:51.483217 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":438,"threads_started":1}
I20260808 23:32:51.486617 28259 heartbeater.cc:347] Connected to a master server at 127.26.207.254:38227
I20260808 23:32:51.486953 28259 heartbeater.cc:464] Registering TS with master...
I20260808 23:32:51.487751 28259 heartbeater.cc:511] Master 127.26.207.254:38227 requested a full tablet report, sending...
I20260808 23:32:51.490113 28060 ts_manager.cc:194] Registered new tserver with Master: 970173bfbe224ffeafa3eccfd90c1715 (127.26.207.193:34711)
I20260808 23:32:51.492311 28060 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:60407
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:32:51.513303 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38227
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:44977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:32:51.877241 28265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:32:51.877578 28265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:32:51.877796 28265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:32:51.886003 28265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:32:51.886143 28265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:32:51.886341 28265 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:32:51.897405 28265 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38227
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:32:51.898895 28265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:32:51.900408 28265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:32:51.915906 28270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:51.915838 28273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:51.915944 28271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:32:51.917098 28265 server_base.cc:1034] running on GCE node
I20260808 23:32:51.917755 28265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:32:51.918885 28265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:32:51.920140 28265 hybrid_clock.cc:648] HybridClock initialized: now 1786231971920071 us; error 55 us; skew 500 ppm
I20260808 23:32:51.920552 28265 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:32:51 dist-test-slave-1x4g krb5kdc[28013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231971, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:32:51.924124 28265 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:32:51.925997 28265 webserver.cc:460] Webserver started at http://127.26.207.194:44621/ using document root <none> and password file <none>
I20260808 23:32:51.926755 28265 fs_manager.cc:359] Metadata directory not provided
I20260808 23:32:51.926968 28265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:32:51.927346 28265 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:32:51.930744 28265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "1a4a3b0f8bee4dd1aafa47aafd41694e"
format_stamp: "Formatted at 2026-08-08 23:32:51 on dist-test-slave-1x4g"
server_key: "5b28e78553099b4eef02b92da02ba3a9"
server_key_iv: "28e892793764cecc86e848e21e207af5"
server_key_version: "encryptionkey@0"
I20260808 23:32:51.931734 28265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "1a4a3b0f8bee4dd1aafa47aafd41694e"
format_stamp: "Formatted at 2026-08-08 23:32:51 on dist-test-slave-1x4g"
server_key: "5b28e78553099b4eef02b92da02ba3a9"
server_key_iv: "28e892793764cecc86e848e21e207af5"
server_key_version: "encryptionkey@0"
I20260808 23:32:51.937978 28265 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 23:32:51.942260 28281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:51.944010 28265 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260808 23:32:51.944249 28265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "1a4a3b0f8bee4dd1aafa47aafd41694e"
format_stamp: "Formatted at 2026-08-08 23:32:51 on dist-test-slave-1x4g"
server_key: "5b28e78553099b4eef02b92da02ba3a9"
server_key_iv: "28e892793764cecc86e848e21e207af5"
server_key_version: "encryptionkey@0"
I20260808 23:32:51.944486 28265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:32:51.971829 28265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:32:51.977391 28265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:32:51.977734 28265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:32:51.978860 28265 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:32:51.980406 28265 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:32:51.980515 28265 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:51.980664 28265 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:32:51.980736 28265 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:52.018775 28265 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:33085
I20260808 23:32:52.018826 28398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:33085 every 8 connection(s)
I20260808 23:32:52.020223 28265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:32:52.027480 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 28265
I20260808 23:32:52.027706 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:32:52.028204 27455 external_mini_cluster.cc:1428] Setting key 7102cdaf7923b164c52893078a018983
Aug 08 23:32:52 dist-test-slave-1x4g krb5kdc[28013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231971, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:32:52.048079 28402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.023198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:45151 (local address 127.26.207.254:38227)
0808 23:32:52.023707 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:52.023712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:52.024678 (+ 966us) server_negotiation.cc:407] Connection header received
0808 23:32:52.026923 (+ 2245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:52.026930 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:52.027036 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:52.027163 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:52.029265 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.030393 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.033329 (+ 2936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.033813 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.033936 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.039611 (+ 5675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:52.039621 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:52.039629 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:52.039689 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:52.043859 (+ 4170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:52.044892 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:52.044901 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:52.044907 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:52.045156 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:52.045688 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:52.045696 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:52.045702 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:52.046150 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:52.046326 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:52.047210 (+ 884us) server_negotiation.cc:299] Negotiation successful
0808 23:32:52.047528 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":290,"threads_started":1}
I20260808 23:32:52.048924 28403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.023702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:38227 (local address 127.26.207.194:45151)
0808 23:32:52.024487 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:52.024530 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:52.026583 (+ 2053us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:52.027480 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:52.027490 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:52.028177 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:32:52.029033 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:52.029068 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.030617 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.030623 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:52.033088 (+ 2465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:52.033119 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.034113 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.034124 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:52.034519 (+ 395us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.035439 (+ 920us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:32:52.035479 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:32:52.039148 (+ 3669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:32:52.044082 (+ 4934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:52.044091 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:52.044108 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:52.044670 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:52.045304 (+ 634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:52.045308 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:52.045310 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:52.045550 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:52.046333 (+ 783us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:32:52.046341 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:32:52.046761 (+ 420us) client_negotiation.cc:769] Sending connection context
0808 23:32:52.047025 (+ 264us) client_negotiation.cc:240] Negotiation successful
0808 23:32:52.047616 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":322,"threads_started":1}
I20260808 23:32:52.050592 28399 heartbeater.cc:347] Connected to a master server at 127.26.207.254:38227
I20260808 23:32:52.050978 28399 heartbeater.cc:464] Registering TS with master...
I20260808 23:32:52.052035 28399 heartbeater.cc:511] Master 127.26.207.254:38227 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
I20260808 23:32:52.054051 28060 ts_manager.cc:194] Registered new tserver with Master: 1a4a3b0f8bee4dd1aafa47aafd41694e (127.26.207.194:33085)
I20260808 23:32:52.055037 28060 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:45151
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:32:52.084244 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38227
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:44977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:32:52.460417 28406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:32:52.460839 28406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:32:52.461051 28406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:32:52.469259 28406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:32:52.469453 28406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:32:52.469643 28406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:32:52.480705 28406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38227
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:32:52.482483 28406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:32:52.484210 28406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 23:32:52.495797 28259 heartbeater.cc:503] Master 127.26.207.254:38227 was elected leader, sending a full tablet report...
W20260808 23:32:52.500699 28414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:52.500617 28412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:52.501353 28411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:32:52.502415 28406 server_base.cc:1034] running on GCE node
I20260808 23:32:52.503185 28406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:32:52.504351 28406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:32:52.505630 28406 hybrid_clock.cc:648] HybridClock initialized: now 1786231972505571 us; error 44 us; skew 500 ppm
I20260808 23:32:52.506049 28406 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:32:52 dist-test-slave-1x4g krb5kdc[28013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231972, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:32:52.514149 28406 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:32:52.516055 28406 webserver.cc:460] Webserver started at http://127.26.207.195:38221/ using document root <none> and password file <none>
I20260808 23:32:52.516870 28406 fs_manager.cc:359] Metadata directory not provided
I20260808 23:32:52.516993 28406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:32:52.517303 28406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:32:52.520648 28406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "6968cd81c3e542aab545ac9591953121"
format_stamp: "Formatted at 2026-08-08 23:32:52 on dist-test-slave-1x4g"
server_key: "dd4102a40c8993704ac0591f08b1ff34"
server_key_iv: "c0ec0a275f6bf1291db8ca0d7b5cbe40"
server_key_version: "encryptionkey@0"
I20260808 23:32:52.521665 28406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "6968cd81c3e542aab545ac9591953121"
format_stamp: "Formatted at 2026-08-08 23:32:52 on dist-test-slave-1x4g"
server_key: "dd4102a40c8993704ac0591f08b1ff34"
server_key_iv: "c0ec0a275f6bf1291db8ca0d7b5cbe40"
server_key_version: "encryptionkey@0"
I20260808 23:32:52.527876 28406 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 23:32:52.531857 28422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:52.533653 28406 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 23:32:52.533886 28406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "6968cd81c3e542aab545ac9591953121"
format_stamp: "Formatted at 2026-08-08 23:32:52 on dist-test-slave-1x4g"
server_key: "dd4102a40c8993704ac0591f08b1ff34"
server_key_iv: "c0ec0a275f6bf1291db8ca0d7b5cbe40"
server_key_version: "encryptionkey@0"
I20260808 23:32:52.534174 28406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:32:52.552663 28406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:32:52.557857 28406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:32:52.558204 28406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:32:52.559306 28406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:32:52.560923 28406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:32:52.561007 28406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:52.561151 28406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:32:52.561209 28406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:52.621186 28406 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:42555
I20260808 23:32:52.621264 28542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:42555 every 8 connection(s)
I20260808 23:32:52.622988 28406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:32:52.629120 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 28406
I20260808 23:32:52.629490 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:32:52.630299 27455 external_mini_cluster.cc:1428] Setting key f76b288e26a3b95a60ea7335229bd51e
Aug 08 23:32:52 dist-test-slave-1x4g krb5kdc[28013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231972, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:32:52.653235 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.626663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:33225 (local address 127.26.207.254:38227)
0808 23:32:52.627545 (+ 882us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:52.627550 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:52.629026 (+ 1476us) server_negotiation.cc:407] Connection header received
0808 23:32:52.632689 (+ 3663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:52.632693 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:52.632811 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:52.632920 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:52.635322 (+ 2402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.636346 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.638961 (+ 2615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.639708 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.639835 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.644889 (+ 5054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:52.644895 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:52.644899 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:52.644939 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:52.649239 (+ 4300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:52.650263 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:52.650273 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:52.650276 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:52.650462 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:52.651005 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:52.651009 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:52.651011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:52.651343 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:52.651548 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:52.652378 (+ 830us) server_negotiation.cc:299] Negotiation successful
0808 23:32:52.652628 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":747,"thread_start_us":546,"threads_started":1}
I20260808 23:32:52.654515 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.627454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:38227 (local address 127.26.207.195:33225)
0808 23:32:52.628755 (+ 1301us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:52.628850 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:52.632303 (+ 3453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:52.633270 (+ 967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:52.633285 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:52.634114 (+ 829us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:32:52.635138 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:52.635162 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.636627 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.636632 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:52.638732 (+ 2100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:52.638752 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.640062 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.640069 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:52.640488 (+ 419us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.641435 (+ 947us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:32:52.641461 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:32:52.644564 (+ 3103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:32:52.649419 (+ 4855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:52.649430 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:52.649453 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:52.650115 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:52.650591 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:52.650597 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:52.650606 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:52.650864 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:52.651506 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:32:52.651516 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:32:52.651981 (+ 465us) client_negotiation.cc:769] Sending connection context
0808 23:32:52.652283 (+ 302us) client_negotiation.cc:240] Negotiation successful
0808 23:32:52.652957 (+ 674us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":845,"thread_start_us":578,"threads_started":1}
I20260808 23:32:52.656585 28543 heartbeater.cc:347] Connected to a master server at 127.26.207.254:38227
I20260808 23:32:52.657006 28543 heartbeater.cc:464] Registering TS with master...
I20260808 23:32:52.658102 28543 heartbeater.cc:511] Master 127.26.207.254:38227 requested a full tablet report, sending...
I20260808 23:32:52.660280 28060 ts_manager.cc:194] Registered new tserver with Master: 6968cd81c3e542aab545ac9591953121 (127.26.207.195:42555)
I20260808 23:32:52.661458 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:32:52.661677 28060 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:33225
I20260808 23:32:52.689225 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.671603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56612 (local address 127.26.207.254:38227)
0808 23:32:52.671930 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:52.671942 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:52.672762 (+ 820us) server_negotiation.cc:407] Connection header received
0808 23:32:52.672971 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:52.672976 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:52.673052 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:52.673152 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:52.675663 (+ 2511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.676649 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.678335 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.678883 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.678995 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.682136 (+ 3141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:52.682141 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:52.682145 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:52.682186 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:52.685765 (+ 3579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:52.686723 (+ 958us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:52.686728 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:52.686731 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:52.686938 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:52.687405 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:52.687409 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:52.687411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:52.687807 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:52.688075 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:52.688550 (+ 475us) server_negotiation.cc:299] Negotiation successful
0808 23:32:52.688837 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260808 23:32:52.699479 28060 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56612:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:32:52.710505 28060 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:32:52.764595 28559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.732157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57934 (local address 127.26.207.195:42555)
0808 23:32:52.747871 (+ 15714us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:52.747880 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:52.747932 (+ 52us) server_negotiation.cc:407] Connection header received
0808 23:32:52.748043 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:52.748051 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:52.748326 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:52.750692 (+ 2366us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:32:52.751307 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.753434 (+ 2127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.760166 (+ 6732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.762190 (+ 2024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.762539 (+ 349us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.762751 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:52.763753 (+ 1002us) server_negotiation.cc:299] Negotiation successful
0808 23:32:52.763963 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15437,"thread_start_us":16373,"threads_started":1}
I20260808 23:32:52.764674 28558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.731601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:42555 (local address 127.0.0.1:57934)
0808 23:32:52.745302 (+ 13701us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:52.745351 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:52.745637 (+ 286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:52.748913 (+ 3276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:52.748922 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:52.748973 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:32:52.750308 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:52.750352 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.753655 (+ 3303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.753661 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:52.759688 (+ 6027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:52.759713 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.762533 (+ 2820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.762540 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:52.763343 (+ 803us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.763449 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 23:32:52.763622 (+ 173us) client_negotiation.cc:240] Negotiation successful
0808 23:32:52.763875 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13339,"mutex_wait_us":66,"spinlock_wait_cycles":6656,"thread_start_us":14911,"threads_started":1}
I20260808 23:32:52.765069 28560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.732893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50148 (local address 127.26.207.193:34711)
0808 23:32:52.746015 (+ 13122us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:52.746025 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:52.747489 (+ 1464us) server_negotiation.cc:407] Connection header received
0808 23:32:52.747647 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:52.747667 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:52.748063 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:52.748417 (+ 354us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:32:52.750766 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.753314 (+ 2548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.759958 (+ 6644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.762228 (+ 2270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.762540 (+ 312us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.762752 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:52.764095 (+ 1343us) server_negotiation.cc:299] Negotiation successful
0808 23:32:52.764378 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11347,"thread_start_us":11060,"threads_started":1}
I20260808 23:32:52.766803 28557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.732188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:34711 (local address 127.0.0.1:50148)
0808 23:32:52.746912 (+ 14724us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:52.746947 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:52.747250 (+ 303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:52.748913 (+ 1663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:52.748922 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:52.748968 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:32:52.750493 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:52.750509 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.753553 (+ 3044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.753560 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:52.759763 (+ 6203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:52.759777 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.763350 (+ 3573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.763355 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:52.763497 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.763521 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 23:32:52.763649 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 23:32:52.763867 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14529,"mutex_wait_us":168,"spinlock_wait_cycles":7168,"thread_start_us":12565,"threads_started":1}
I20260808 23:32:52.770465 28561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.747119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:33085 (local address 127.0.0.1:54038)
0808 23:32:52.757373 (+ 10254us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:52.757402 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:52.757652 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:52.758479 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:52.758484 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:52.758513 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:32:52.759503 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:52.759518 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.761849 (+ 2331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.761857 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:52.766132 (+ 4275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:52.766154 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.769291 (+ 3137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.769301 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:52.769509 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.769559 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 23:32:52.769649 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 23:32:52.769836 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9902,"mutex_wait_us":1,"thread_start_us":9704,"threads_started":1}
I20260808 23:32:52.771241 28473 tablet_service.cc:1467] Processing CreateTablet for tablet 29cbd25430a8426fb578463339192917 (DEFAULT_TABLE table=test-table [id=1fd3de28b2034d8ab207e44fc1096260]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:32:52.770886 28191 tablet_service.cc:1467] Processing CreateTablet for tablet 29cbd25430a8426fb578463339192917 (DEFAULT_TABLE table=test-table [id=1fd3de28b2034d8ab207e44fc1096260]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:32:52.772334 28562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.747480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54038 (local address 127.26.207.194:33085)
0808 23:32:52.757864 (+ 10384us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:52.757872 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:52.757899 (+ 27us) server_negotiation.cc:407] Connection header received
0808 23:32:52.757990 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:52.757996 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:52.758249 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:52.758493 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:32:52.759803 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.761688 (+ 1885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.766479 (+ 4791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.768708 (+ 2229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.771023 (+ 2315us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.771390 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:52.771480 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 23:32:52.771831 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10137,"thread_start_us":9972,"threads_started":1}
I20260808 23:32:52.773636 28473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29cbd25430a8426fb578463339192917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:32:52.773746 28191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29cbd25430a8426fb578463339192917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:32:52.778425 28331 tablet_service.cc:1467] Processing CreateTablet for tablet 29cbd25430a8426fb578463339192917 (DEFAULT_TABLE table=test-table [id=1fd3de28b2034d8ab207e44fc1096260]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:32:52.781683 28331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29cbd25430a8426fb578463339192917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:32:52.802656 28565 tablet_bootstrap.cc:492] T 29cbd25430a8426fb578463339192917 P 6968cd81c3e542aab545ac9591953121: Bootstrap starting.
I20260808 23:32:52.803751 28564 tablet_bootstrap.cc:492] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715: Bootstrap starting.
I20260808 23:32:52.809355 28564 tablet_bootstrap.cc:654] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715: Neither blocks nor log segments found. Creating new log.
I20260808 23:32:52.809609 28565 tablet_bootstrap.cc:654] T 29cbd25430a8426fb578463339192917 P 6968cd81c3e542aab545ac9591953121: Neither blocks nor log segments found. Creating new log.
I20260808 23:32:52.811159 28566 tablet_bootstrap.cc:492] T 29cbd25430a8426fb578463339192917 P 1a4a3b0f8bee4dd1aafa47aafd41694e: Bootstrap starting.
I20260808 23:32:52.811311 28564 log.cc:824] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715: Log is configured to *not* fsync() on all Append() calls
I20260808 23:32:52.811553 28565 log.cc:824] T 29cbd25430a8426fb578463339192917 P 6968cd81c3e542aab545ac9591953121: Log is configured to *not* fsync() on all Append() calls
I20260808 23:32:52.818495 28566 tablet_bootstrap.cc:654] T 29cbd25430a8426fb578463339192917 P 1a4a3b0f8bee4dd1aafa47aafd41694e: Neither blocks nor log segments found. Creating new log.
I20260808 23:32:52.820259 28566 log.cc:824] T 29cbd25430a8426fb578463339192917 P 1a4a3b0f8bee4dd1aafa47aafd41694e: Log is configured to *not* fsync() on all Append() calls
I20260808 23:32:52.821489 28564 tablet_bootstrap.cc:492] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715: No bootstrap required, opened a new log
I20260808 23:32:52.821489 28565 tablet_bootstrap.cc:492] T 29cbd25430a8426fb578463339192917 P 6968cd81c3e542aab545ac9591953121: No bootstrap required, opened a new log
I20260808 23:32:52.821835 28564 ts_tablet_manager.cc:1397] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.007s
I20260808 23:32:52.821835 28565 ts_tablet_manager.cc:1397] T 29cbd25430a8426fb578463339192917 P 6968cd81c3e542aab545ac9591953121: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.008s
I20260808 23:32:52.823768 28566 tablet_bootstrap.cc:492] T 29cbd25430a8426fb578463339192917 P 1a4a3b0f8bee4dd1aafa47aafd41694e: No bootstrap required, opened a new log
I20260808 23:32:52.824115 28566 ts_tablet_manager.cc:1397] T 29cbd25430a8426fb578463339192917 P 1a4a3b0f8bee4dd1aafa47aafd41694e: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.006s
I20260808 23:32:52.835492 28565 raft_consensus.cc:348] T 29cbd25430a8426fb578463339192917 P 6968cd81c3e542aab545ac9591953121 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6968cd81c3e542aab545ac9591953121" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 42555 } } peers { permanent_uuid: "1a4a3b0f8bee4dd1aafa47aafd41694e" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33085 } } peers { permanent_uuid: "970173bfbe224ffeafa3eccfd90c1715" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34711 } }
I20260808 23:32:52.835492 28564 raft_consensus.cc:348] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6968cd81c3e542aab545ac9591953121" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 42555 } } peers { permanent_uuid: "1a4a3b0f8bee4dd1aafa47aafd41694e" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33085 } } peers { permanent_uuid: "970173bfbe224ffeafa3eccfd90c1715" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34711 } }
I20260808 23:32:52.836054 28564 raft_consensus.cc:374] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:32:52.836104 28565 raft_consensus.cc:374] T 29cbd25430a8426fb578463339192917 P 6968cd81c3e542aab545ac9591953121 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:32:52.836205 28564 raft_consensus.cc:729] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 970173bfbe224ffeafa3eccfd90c1715, State: Initialized, Role: FOLLOWER
I20260808 23:32:52.836234 28565 raft_consensus.cc:729] T 29cbd25430a8426fb578463339192917 P 6968cd81c3e542aab545ac9591953121 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6968cd81c3e542aab545ac9591953121, State: Initialized, Role: FOLLOWER
I20260808 23:32:52.837065 28564 consensus_queue.cc:260] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6968cd81c3e542aab545ac9591953121" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 42555 } } peers { permanent_uuid: "1a4a3b0f8bee4dd1aafa47aafd41694e" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33085 } } peers { permanent_uuid: "970173bfbe224ffeafa3eccfd90c1715" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34711 } }
I20260808 23:32:52.837035 28565 consensus_queue.cc:260] T 29cbd25430a8426fb578463339192917 P 6968cd81c3e542aab545ac9591953121 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6968cd81c3e542aab545ac9591953121" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 42555 } } peers { permanent_uuid: "1a4a3b0f8bee4dd1aafa47aafd41694e" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33085 } } peers { permanent_uuid: "970173bfbe224ffeafa3eccfd90c1715" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34711 } }
I20260808 23:32:52.837177 28566 raft_consensus.cc:348] T 29cbd25430a8426fb578463339192917 P 1a4a3b0f8bee4dd1aafa47aafd41694e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6968cd81c3e542aab545ac9591953121" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 42555 } } peers { permanent_uuid: "1a4a3b0f8bee4dd1aafa47aafd41694e" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33085 } } peers { permanent_uuid: "970173bfbe224ffeafa3eccfd90c1715" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34711 } }
I20260808 23:32:52.837803 28566 raft_consensus.cc:374] T 29cbd25430a8426fb578463339192917 P 1a4a3b0f8bee4dd1aafa47aafd41694e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:32:52.837945 28566 raft_consensus.cc:729] T 29cbd25430a8426fb578463339192917 P 1a4a3b0f8bee4dd1aafa47aafd41694e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4a3b0f8bee4dd1aafa47aafd41694e, State: Initialized, Role: FOLLOWER
I20260808 23:32:52.838914 28566 consensus_queue.cc:260] T 29cbd25430a8426fb578463339192917 P 1a4a3b0f8bee4dd1aafa47aafd41694e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6968cd81c3e542aab545ac9591953121" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 42555 } } peers { permanent_uuid: "1a4a3b0f8bee4dd1aafa47aafd41694e" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33085 } } peers { permanent_uuid: "970173bfbe224ffeafa3eccfd90c1715" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34711 } }
I20260808 23:32:52.841144 28543 heartbeater.cc:503] Master 127.26.207.254:38227 was elected leader, sending a full tablet report...
I20260808 23:32:52.841269 28565 ts_tablet_manager.cc:1428] T 29cbd25430a8426fb578463339192917 P 6968cd81c3e542aab545ac9591953121: Time spent starting tablet: real 0.019s user 0.013s sys 0.004s
I20260808 23:32:52.842574 28564 ts_tablet_manager.cc:1428] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715: Time spent starting tablet: real 0.019s user 0.018s sys 0.001s
I20260808 23:32:52.843686 28399 heartbeater.cc:503] Master 127.26.207.254:38227 was elected leader, sending a full tablet report...
I20260808 23:32:52.846602 28566 ts_tablet_manager.cc:1428] T 29cbd25430a8426fb578463339192917 P 1a4a3b0f8bee4dd1aafa47aafd41694e: Time spent starting tablet: real 0.022s user 0.016s sys 0.005s
I20260808 23:32:52.850304 28570 raft_consensus.cc:482] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:32:52.850718 28570 raft_consensus.cc:504] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6968cd81c3e542aab545ac9591953121" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 42555 } } peers { permanent_uuid: "1a4a3b0f8bee4dd1aafa47aafd41694e" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33085 } } peers { permanent_uuid: "970173bfbe224ffeafa3eccfd90c1715" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34711 } }
I20260808 23:32:52.853037 28570 leader_election.cc:288] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6968cd81c3e542aab545ac9591953121 (127.26.207.195:42555), 1a4a3b0f8bee4dd1aafa47aafd41694e (127.26.207.194:33085)
I20260808 23:32:52.863586 28562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.854769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:40267 (local address 127.26.207.194:33085)
0808 23:32:52.855014 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:52.855027 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:52.855276 (+ 249us) server_negotiation.cc:407] Connection header received
0808 23:32:52.855460 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:52.855464 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:52.855529 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:52.855647 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:32:52.856271 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.857485 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.860444 (+ 2959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.861977 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.862175 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.862258 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:52.863112 (+ 854us) server_negotiation.cc:299] Negotiation successful
0808 23:32:52.863271 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 23:32:52.863565 28559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.853414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:52457 (local address 127.26.207.195:42555)
0808 23:32:52.853700 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:52.853710 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:52.854313 (+ 603us) server_negotiation.cc:407] Connection header received
0808 23:32:52.854570 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:52.854575 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:52.854668 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:52.854780 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:32:52.855678 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.857182 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.860436 (+ 3254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.861977 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.862176 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.862258 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:52.863112 (+ 854us) server_negotiation.cc:299] Negotiation successful
0808 23:32:52.863271 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 23:32:52.863953 28574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.854422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:33085 (local address 127.26.207.193:40267)
0808 23:32:52.855151 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:52.855174 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:52.855330 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:52.855659 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:52.855663 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:52.855691 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:32:52.856104 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:52.856113 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.857621 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.857626 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:52.860194 (+ 2568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:52.860215 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.862375 (+ 2160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.862380 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:52.862805 (+ 425us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.862910 (+ 105us) client_negotiation.cc:769] Sending connection context
0808 23:32:52.863039 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 23:32:52.863300 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"mutex_wait_us":294,"thread_start_us":334,"threads_started":1}
I20260808 23:32:52.863979 28573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.853442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:42555 (local address 127.26.207.193:52457)
0808 23:32:52.854189 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:52.854207 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:52.854387 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:52.855023 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:52.855028 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:52.855058 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:32:52.855524 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:52.855534 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.857348 (+ 1814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.857352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:52.860194 (+ 2842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:52.860215 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.862361 (+ 2146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.862385 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:52.862803 (+ 418us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.862907 (+ 104us) client_negotiation.cc:769] Sending connection context
0808 23:32:52.863039 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 23:32:52.863300 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"mutex_wait_us":326,"thread_start_us":409,"threads_started":1}
I20260808 23:32:52.865496 28352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29cbd25430a8426fb578463339192917" candidate_uuid: "970173bfbe224ffeafa3eccfd90c1715" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4a3b0f8bee4dd1aafa47aafd41694e" is_pre_election: true
I20260808 23:32:52.865496 28495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29cbd25430a8426fb578463339192917" candidate_uuid: "970173bfbe224ffeafa3eccfd90c1715" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6968cd81c3e542aab545ac9591953121" is_pre_election: true
I20260808 23:32:52.866417 28352 raft_consensus.cc:2454] T 29cbd25430a8426fb578463339192917 P 1a4a3b0f8bee4dd1aafa47aafd41694e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 970173bfbe224ffeafa3eccfd90c1715 in term 0.
I20260808 23:32:52.867429 28140 leader_election.cc:302] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4a3b0f8bee4dd1aafa47aafd41694e, 970173bfbe224ffeafa3eccfd90c1715; no voters:
I20260808 23:32:52.868723 28495 raft_consensus.cc:2454] T 29cbd25430a8426fb578463339192917 P 6968cd81c3e542aab545ac9591953121 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 970173bfbe224ffeafa3eccfd90c1715 in term 0.
I20260808 23:32:52.869378 28570 raft_consensus.cc:2781] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:32:52.869650 28570 raft_consensus.cc:482] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:32:52.869802 28570 raft_consensus.cc:3037] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:32:52.872351 28570 raft_consensus.cc:504] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6968cd81c3e542aab545ac9591953121" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 42555 } } peers { permanent_uuid: "1a4a3b0f8bee4dd1aafa47aafd41694e" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33085 } } peers { permanent_uuid: "970173bfbe224ffeafa3eccfd90c1715" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34711 } }
I20260808 23:32:52.873247 28570 leader_election.cc:288] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [CANDIDATE]: Term 1 election: Requested vote from peers 6968cd81c3e542aab545ac9591953121 (127.26.207.195:42555), 1a4a3b0f8bee4dd1aafa47aafd41694e (127.26.207.194:33085)
I20260808 23:32:52.873955 28495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29cbd25430a8426fb578463339192917" candidate_uuid: "970173bfbe224ffeafa3eccfd90c1715" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6968cd81c3e542aab545ac9591953121"
I20260808 23:32:52.873968 28352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29cbd25430a8426fb578463339192917" candidate_uuid: "970173bfbe224ffeafa3eccfd90c1715" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4a3b0f8bee4dd1aafa47aafd41694e"
I20260808 23:32:52.874193 28495 raft_consensus.cc:3037] T 29cbd25430a8426fb578463339192917 P 6968cd81c3e542aab545ac9591953121 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:32:52.874203 28352 raft_consensus.cc:3037] T 29cbd25430a8426fb578463339192917 P 1a4a3b0f8bee4dd1aafa47aafd41694e [term 0 FOLLOWER]: Advancing to term 1
W20260808 23:32:52.875749 28544 tablet.cc:2369] T 29cbd25430a8426fb578463339192917 P 6968cd81c3e542aab545ac9591953121: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:32:52.877149 28352 raft_consensus.cc:2454] T 29cbd25430a8426fb578463339192917 P 1a4a3b0f8bee4dd1aafa47aafd41694e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 970173bfbe224ffeafa3eccfd90c1715 in term 1.
I20260808 23:32:52.877663 28495 raft_consensus.cc:2454] T 29cbd25430a8426fb578463339192917 P 6968cd81c3e542aab545ac9591953121 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 970173bfbe224ffeafa3eccfd90c1715 in term 1.
I20260808 23:32:52.877802 28140 leader_election.cc:302] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4a3b0f8bee4dd1aafa47aafd41694e, 970173bfbe224ffeafa3eccfd90c1715; no voters:
I20260808 23:32:52.878247 28570 raft_consensus.cc:2781] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:32:52.878953 28570 raft_consensus.cc:686] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [term 1 LEADER]: Becoming Leader. State: Replica: 970173bfbe224ffeafa3eccfd90c1715, State: Running, Role: LEADER
I20260808 23:32:52.879580 28570 consensus_queue.cc:237] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6968cd81c3e542aab545ac9591953121" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 42555 } } peers { permanent_uuid: "1a4a3b0f8bee4dd1aafa47aafd41694e" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33085 } } peers { permanent_uuid: "970173bfbe224ffeafa3eccfd90c1715" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34711 } }
I20260808 23:32:52.885619 28057 catalog_manager.cc:5495] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715 reported cstate change: term changed from 0 to 1, leader changed from <none> to 970173bfbe224ffeafa3eccfd90c1715 (127.26.207.193). New cstate: current_term: 1 leader_uuid: "970173bfbe224ffeafa3eccfd90c1715" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6968cd81c3e542aab545ac9591953121" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 42555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a4a3b0f8bee4dd1aafa47aafd41694e" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "970173bfbe224ffeafa3eccfd90c1715" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34711 } health_report { overall_health: HEALTHY } } }
Aug 08 23:32:52 dist-test-slave-1x4g krb5kdc[28013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231970, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:32:52.918481 28560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.895122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50160 (local address 127.26.207.193:34711)
0808 23:32:52.895405 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:52.895410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:52.896562 (+ 1152us) server_negotiation.cc:407] Connection header received
0808 23:32:52.896891 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:52.896898 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:52.896980 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:52.897123 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:52.899896 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.900755 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.902881 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.903456 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.903619 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.909752 (+ 6133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:52.909773 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:52.909791 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:52.909840 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:52.914296 (+ 4456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:52.915427 (+ 1131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:52.915436 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:52.915439 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:52.915719 (+ 280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:52.916361 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:52.916370 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:52.916373 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:52.916997 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:52.917384 (+ 387us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:52.917753 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 23:32:52.918055 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
Aug 08 23:32:52 dist-test-slave-1x4g krb5kdc[28013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231972, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260808 23:32:52.962117 28260 tablet.cc:2369] T 29cbd25430a8426fb578463339192917 P 970173bfbe224ffeafa3eccfd90c1715: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 23:32:52 dist-test-slave-1x4g krb5kdc[28013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231972, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:32:52.983832 28560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:52.963314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50164 (local address 127.26.207.193:34711)
0808 23:32:52.963524 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:52.963529 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:52.964335 (+ 806us) server_negotiation.cc:407] Connection header received
0808 23:32:52.964600 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:52.964612 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:52.964685 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:52.964828 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:52.967287 (+ 2459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.968357 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.970235 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:52.970822 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:52.971006 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:52.976855 (+ 5849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:52.976863 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:52.976867 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:52.976916 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:52.980696 (+ 3780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:52.981662 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:52.981667 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:52.981670 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:52.981853 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:52.982341 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:52.982344 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:52.982346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:52.982734 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:52.983072 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:52.983180 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 23:32:52.983404 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
Aug 08 23:32:53 dist-test-slave-1x4g krb5kdc[28013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231973, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
W20260808 23:32:53.022662 28401 tablet.cc:2369] T 29cbd25430a8426fb578463339192917 P 1a4a3b0f8bee4dd1aafa47aafd41694e: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 23:32:53 dist-test-slave-1x4g krb5kdc[28013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231973, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:32:53.048267 28560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:53.028751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50172 (local address 127.26.207.193:34711)
0808 23:32:53.029077 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:53.029087 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:53.029615 (+ 528us) server_negotiation.cc:407] Connection header received
0808 23:32:53.029817 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:53.029821 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:53.029907 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:53.030007 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:53.032199 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:53.033175 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:53.035391 (+ 2216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:53.035859 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:53.035972 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:53.041455 (+ 5483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:53.041462 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:53.041466 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:53.041515 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:53.045032 (+ 3517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:53.045825 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:53.045829 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:53.045832 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:53.046055 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:53.046552 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:53.046556 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:53.046558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:53.046954 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:53.047249 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:53.047516 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 23:32:53.047751 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
W20260808 23:32:53.051084 28168 tablet_service.cc:2908] Rejecting scan request for tablet 29cbd25430a8426fb578463339192917: Uninitialized: clean time has not yet been initialized
I20260808 23:32:53.055382 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 28124
I20260808 23:32:53.069831 28560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:53.056568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50178 (local address 127.26.207.193:34711)
0808 23:32:53.056810 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:53.056819 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:53.057114 (+ 295us) server_negotiation.cc:407] Connection header received
0808 23:32:53.057265 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:53.057269 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:53.057360 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:53.057466 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:53.058775 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:53.059604 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:53.060959 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:53.061397 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:53.061502 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:53.063821 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:53.063827 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:53.063830 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:53.063868 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:53.066974 (+ 3106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:53.067806 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:53.067810 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:53.067813 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:53.068007 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:53.068394 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:53.068397 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:53.068400 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:53.068694 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:53.068984 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:53.069322 (+ 338us) server_negotiation.cc:299] Negotiation successful
0808 23:32:53.069546 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 23:32:53.070645 28253 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:32:53.165856 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 28124
I20260808 23:32:53.188957 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 28265
Aug 08 23:32:53 dist-test-slave-1x4g krb5kdc[28013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231973, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:32:53.206090 28562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:53.189872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54040 (local address 127.26.207.194:33085)
0808 23:32:53.190070 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:53.190075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:53.190096 (+ 21us) server_negotiation.cc:407] Connection header received
0808 23:32:53.190410 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:53.190415 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:53.190486 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:53.190614 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:53.191858 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:53.193042 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:53.194525 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:53.194966 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:53.195090 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:53.199868 (+ 4778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:53.199887 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:53.199926 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:53.199972 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:53.203182 (+ 3210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:53.203966 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:53.203974 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:53.203976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:53.204130 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:53.204535 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:53.204539 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:53.204543 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:53.205084 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:53.205375 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:53.205604 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 23:32:53.205802 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 23:32:53.206796 28394 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:32:53.299062 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 28265
I20260808 23:32:53.320869 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 28406
Aug 08 23:32:53 dist-test-slave-1x4g krb5kdc[28013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231973, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:32:53.338986 28559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:53.321760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57948 (local address 127.26.207.195:42555)
0808 23:32:53.321987 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:53.321995 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:53.322052 (+ 57us) server_negotiation.cc:407] Connection header received
0808 23:32:53.322323 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:53.322328 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:53.322416 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:53.322542 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:53.324022 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:53.324975 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:53.326500 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:53.327017 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:53.327169 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:53.332128 (+ 4959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:53.332149 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:53.332166 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:53.332219 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:53.335370 (+ 3151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:53.336260 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:53.336269 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:53.336272 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:53.336428 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:53.337112 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:53.337118 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:53.337125 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:53.337564 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:53.337890 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:53.338237 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 23:32:53.338592 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 23:32:53.339735 28537 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:32:53.431061 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 28406
I20260808 23:32:53.452987 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 28028
I20260808 23:32:53.454365 28090 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:32:53.568441 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 28028
2026-08-08T23:32:53Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4674 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:32:53 dist-test-slave-1x4g krb5kdc[28594](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:32:53 dist-test-slave-1x4g krb5kdc[28594](info): set up 2 sockets
Aug 08 23:32:53 dist-test-slave-1x4g krb5kdc[28594](info): commencing operation
krb5kdc: starting...
W20260808 23:32:54.711745 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:32:54 dist-test-slave-1x4g krb5kdc[28594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:32:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:32:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:32:54.949590 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:37841
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:39905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:37841
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:32:55.303357 28607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:32:55.303697 28607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:32:55.303795 28607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:32:55.311414 28607 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:32:55.311542 28607 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 23:32:55.311583 28607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:32:55.311638 28607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:32:55.311689 28607 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:32:55.311751 28607 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:32:55.322355 28607 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:39905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:37841
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:37841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:32:55.323755 28607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:32:55.325214 28607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:32:55.338155 28612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:55.338227 28613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:55.338253 28615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:32:55.339417 28607 server_base.cc:1034] running on GCE node
I20260808 23:32:55.340322 28607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:32:55.341981 28607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:32:55.343251 28607 hybrid_clock.cc:648] HybridClock initialized: now 1786231975343183 us; error 40 us; skew 500 ppm
I20260808 23:32:55.343608 28607 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:32:55 dist-test-slave-1x4g krb5kdc[28594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231975, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:32:55.347236 28607 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:32:55.349000 28607 webserver.cc:460] Webserver started at http://127.26.207.254:34105/ using document root <none> and password file <none>
I20260808 23:32:55.349802 28607 fs_manager.cc:359] Metadata directory not provided
I20260808 23:32:55.349943 28607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:32:55.350327 28607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:32:55.353777 28607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "7f272a93f25b40d98188e0455b1f4e41"
format_stamp: "Formatted at 2026-08-08 23:32:55 on dist-test-slave-1x4g"
server_key: "d45b6f33d0bbc41acc631b3706b9a96e"
server_key_iv: "763e6593794dea1113e871a6b303bbb2"
server_key_version: "encryptionkey@0"
I20260808 23:32:55.354769 28607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "7f272a93f25b40d98188e0455b1f4e41"
format_stamp: "Formatted at 2026-08-08 23:32:55 on dist-test-slave-1x4g"
server_key: "d45b6f33d0bbc41acc631b3706b9a96e"
server_key_iv: "763e6593794dea1113e871a6b303bbb2"
server_key_version: "encryptionkey@0"
I20260808 23:32:55.360891 28607 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 23:32:55.365157 28622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:55.366782 28607 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:32:55.367012 28607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "7f272a93f25b40d98188e0455b1f4e41"
format_stamp: "Formatted at 2026-08-08 23:32:55 on dist-test-slave-1x4g"
server_key: "d45b6f33d0bbc41acc631b3706b9a96e"
server_key_iv: "763e6593794dea1113e871a6b303bbb2"
server_key_version: "encryptionkey@0"
I20260808 23:32:55.367297 28607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:32:55.385497 28607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:32:55.390185 28607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:32:55.390435 28607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:32:55.415082 28607 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:37841
I20260808 23:32:55.415130 28685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:37841 every 8 connection(s)
I20260808 23:32:55.416672 28607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:32:55.421422 28686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:32:55.423024 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 28607
I20260808 23:32:55.423280 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:32:55.424002 27455 external_mini_cluster.cc:1428] Setting key fe714519fa91ee30e649311d2c938344
I20260808 23:32:55.435637 28686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41: Bootstrap starting.
I20260808 23:32:55.440481 28686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41: Neither blocks nor log segments found. Creating new log.
Aug 08 23:32:55 dist-test-slave-1x4g krb5kdc[28594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:32:55.441922 28686 log.cc:824] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41: Log is configured to *not* fsync() on all Append() calls
I20260808 23:32:55.445878 28686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41: No bootstrap required, opened a new log
I20260808 23:32:55.452443 28689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:55.426415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36888 (local address 127.26.207.254:37841)
0808 23:32:55.427412 (+ 997us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:55.427426 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:55.427482 (+ 56us) server_negotiation.cc:407] Connection header received
0808 23:32:55.429613 (+ 2131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:55.429645 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:55.430103 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:55.430497 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:55.432657 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:55.434268 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:55.436236 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:55.437159 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:55.437332 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:55.442865 (+ 5533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:55.442877 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:55.442896 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:55.442941 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:55.447127 (+ 4186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:55.447993 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:55.448004 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:55.448019 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:55.448269 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:55.448681 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:55.448686 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:55.448689 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:55.449585 (+ 896us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:55.449910 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:55.450307 (+ 397us) server_negotiation.cc:299] Negotiation successful
0808 23:32:55.450871 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":469,"threads_started":1}
I20260808 23:32:55.456923 28686 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f272a93f25b40d98188e0455b1f4e41" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37841 } }
I20260808 23:32:55.457316 28686 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:32:55.457401 28686 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f272a93f25b40d98188e0455b1f4e41, State: Initialized, Role: FOLLOWER
I20260808 23:32:55.457955 28686 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f272a93f25b40d98188e0455b1f4e41" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37841 } }
I20260808 23:32:55.458184 28686 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:32:55.458283 28686 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:32:55.458455 28686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:32:55.461166 28686 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f272a93f25b40d98188e0455b1f4e41" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37841 } }
I20260808 23:32:55.461773 28686 leader_election.cc:302] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f272a93f25b40d98188e0455b1f4e41; no voters:
I20260808 23:32:55.462558 28686 leader_election.cc:288] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:32:55.462742 28691 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:32:55.463603 28691 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [term 1 LEADER]: Becoming Leader. State: Replica: 7f272a93f25b40d98188e0455b1f4e41, State: Running, Role: LEADER
I20260808 23:32:55.464242 28691 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f272a93f25b40d98188e0455b1f4e41" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37841 } }
I20260808 23:32:55.465097 28686 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:32:55.467754 28693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f272a93f25b40d98188e0455b1f4e41. Latest consensus state: current_term: 1 leader_uuid: "7f272a93f25b40d98188e0455b1f4e41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f272a93f25b40d98188e0455b1f4e41" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37841 } } }
I20260808 23:32:55.468195 28693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [sys.catalog]: This master's current role is: LEADER
I20260808 23:32:55.469015 28692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f272a93f25b40d98188e0455b1f4e41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f272a93f25b40d98188e0455b1f4e41" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37841 } } }
I20260808 23:32:55.469519 28692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41 [sys.catalog]: This master's current role is: LEADER
I20260808 23:32:55.471186 28698 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:32:55.479046 28698 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:32:55.491976 28698 catalog_manager.cc:1347] Generated new cluster ID: bfd90b9dc2a94fcb8b6e96566fc3f861
I20260808 23:32:55.492141 28698 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:32:55.500339 28698 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:32:55.502518 28698 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:32:55.511830 28698 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41: Generated new TSK 0
I20260808 23:32:55.513077 28698 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:32:55.581875 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:37841
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:39905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:32:55.946686 28713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:32:55.947016 28713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:32:55.947228 28713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:32:55.955067 28713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:32:55.955186 28713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:32:55.955349 28713 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 23:32:55.955482 28713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:32:55.966162 28713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:39905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.207.254:37841
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:32:55.967666 28713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:32:55.969311 28713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:32:55.984875 28719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:55.984927 28718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:55.984853 28721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:32:55.987167 28713 server_base.cc:1034] running on GCE node
I20260808 23:32:55.987998 28713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:32:55.989208 28713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:32:55.990489 28713 hybrid_clock.cc:648] HybridClock initialized: now 1786231975990415 us; error 43 us; skew 500 ppm
I20260808 23:32:55.990833 28713 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:32:55 dist-test-slave-1x4g krb5kdc[28594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231975, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:32:55.994437 28713 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:32:55.996068 28713 webserver.cc:460] Webserver started at http://127.26.207.193:43547/ using document root <none> and password file <none>
I20260808 23:32:55.996949 28713 fs_manager.cc:359] Metadata directory not provided
I20260808 23:32:55.997089 28713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:32:55.997457 28713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:32:56.000737 28713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "4fe5fcb21a1549f1bb985eaed377bdbe"
format_stamp: "Formatted at 2026-08-08 23:32:55 on dist-test-slave-1x4g"
server_key: "24c5fb6db93febd21e8c0291bdf9593d"
server_key_iv: "8c4b24ba40ee411acdb76fd96730653f"
server_key_version: "encryptionkey@0"
I20260808 23:32:56.001757 28713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "4fe5fcb21a1549f1bb985eaed377bdbe"
format_stamp: "Formatted at 2026-08-08 23:32:55 on dist-test-slave-1x4g"
server_key: "24c5fb6db93febd21e8c0291bdf9593d"
server_key_iv: "8c4b24ba40ee411acdb76fd96730653f"
server_key_version: "encryptionkey@0"
I20260808 23:32:56.008013 28713 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 23:32:56.012595 28728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:56.014376 28713 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:32:56.014657 28713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "4fe5fcb21a1549f1bb985eaed377bdbe"
format_stamp: "Formatted at 2026-08-08 23:32:55 on dist-test-slave-1x4g"
server_key: "24c5fb6db93febd21e8c0291bdf9593d"
server_key_iv: "8c4b24ba40ee411acdb76fd96730653f"
server_key_version: "encryptionkey@0"
I20260808 23:32:56.015024 28713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:32:56.035110 28713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:32:56.040027 28713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:32:56.040345 28713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:32:56.043823 28713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:32:56.043951 28713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:56.044098 28713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:32:56.044176 28713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 23:32:56 dist-test-slave-1x4g krb5kdc[28594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231975, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:32:56.075309 28738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:56.044591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:53263 (local address 127.26.207.254:37841)
0808 23:32:56.046435 (+ 1844us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:56.046441 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:56.046957 (+ 516us) server_negotiation.cc:407] Connection header received
0808 23:32:56.049871 (+ 2914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:56.049881 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:56.050026 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:56.050176 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:56.053322 (+ 3146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:56.054710 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:56.058144 (+ 3434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:56.058988 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:56.059214 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:56.065492 (+ 6278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:56.065498 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:56.065502 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:56.065546 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:56.069538 (+ 3992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:56.071344 (+ 1806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:56.071351 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:56.071355 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:56.071583 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:56.072350 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:56.072356 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:56.072360 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:56.072737 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:56.073029 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:56.074425 (+ 1396us) server_negotiation.cc:299] Negotiation successful
0808 23:32:56.074770 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1699,"thread_start_us":1562,"threads_started":1}
I20260808 23:32:56.077325 28739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:56.045526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:37841 (local address 127.26.207.193:53263)
0808 23:32:56.046753 (+ 1227us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:56.046808 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:56.049442 (+ 2634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:56.050588 (+ 1146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:56.050605 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:56.051735 (+ 1130us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:32:56.052987 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:56.053032 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:56.054954 (+ 1922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:56.054960 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:56.057874 (+ 2914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:56.057907 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:56.059338 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:56.059347 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:56.059779 (+ 432us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:56.060967 (+ 1188us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:32:56.061007 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:32:56.065138 (+ 4131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:32:56.069825 (+ 4687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:56.069841 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:56.069872 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:56.071075 (+ 1203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:56.071784 (+ 709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:56.071791 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:56.071797 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:56.072170 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:56.072943 (+ 773us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:32:56.072961 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:32:56.073754 (+ 793us) client_negotiation.cc:769] Sending connection context
0808 23:32:56.074229 (+ 475us) client_negotiation.cc:240] Negotiation successful
0808 23:32:56.075111 (+ 882us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":924,"thread_start_us":638,"threads_started":1}
I20260808 23:32:56.087100 28713 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:38051
I20260808 23:32:56.087363 28851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:38051 every 8 connection(s)
I20260808 23:32:56.089123 28713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:32:56.091962 28854 heartbeater.cc:347] Connected to a master server at 127.26.207.254:37841
I20260808 23:32:56.092279 28854 heartbeater.cc:464] Registering TS with master...
I20260808 23:32:56.093194 28854 heartbeater.cc:511] Master 127.26.207.254:37841 requested a full tablet report, sending...
I20260808 23:32:56.095860 28639 ts_manager.cc:194] Registered new tserver with Master: 4fe5fcb21a1549f1bb985eaed377bdbe (127.26.207.193:38051)
I20260808 23:32:56.097667 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 28713
I20260808 23:32:56.097889 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:32:56.098224 28639 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:53263
I20260808 23:32:56.098759 27455 external_mini_cluster.cc:1428] Setting key 0eefd1479315c1f834a628bb97d37317
I20260808 23:32:56.102262 28738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:56.086885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:37963 (local address 127.26.207.254:37841)
0808 23:32:56.087153 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:56.087162 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:56.087964 (+ 802us) server_negotiation.cc:407] Connection header received
0808 23:32:56.088119 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:56.088125 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:56.088222 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:56.088358 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:56.089538 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:56.090732 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:56.092487 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:56.092997 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:56.093110 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:56.095339 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:56.095344 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:56.095348 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:56.095383 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:56.098878 (+ 3495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:56.099827 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:56.099833 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:56.099837 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:56.100067 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:56.100548 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:56.100553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:56.100557 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:56.100990 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:56.101173 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:56.101609 (+ 436us) server_negotiation.cc:299] Negotiation successful
0808 23:32:56.101865 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 23:32:56.102365 28853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:56.086964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:37841 (local address 127.26.207.193:37963)
0808 23:32:56.087831 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:56.087848 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:56.087995 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:56.088380 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:56.088384 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:56.088940 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:32:56.089345 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:56.089360 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:56.090895 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:56.090903 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:56.092331 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:56.092351 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:56.093214 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:56.093224 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:56.093431 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:56.094097 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:32:56.094122 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:32:56.095147 (+ 1025us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:32:56.099059 (+ 3912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:56.099065 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:56.099070 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:56.099715 (+ 645us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:56.100216 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:56.100221 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:56.100225 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:56.100407 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:56.101112 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:32:56.101117 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:32:56.101321 (+ 204us) client_negotiation.cc:769] Sending connection context
0808 23:32:56.101479 (+ 158us) client_negotiation.cc:240] Negotiation successful
0808 23:32:56.101878 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":710,"mutex_wait_us":3,"thread_start_us":465,"threads_started":1}
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:32:56.150430 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:37841
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:39905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:32:56.509016 28858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:32:56.509414 28858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:32:56.509603 28858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:32:56.517436 28858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:32:56.517642 28858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:32:56.517791 28858 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 23:32:56.517931 28858 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:32:56.528663 28858 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:39905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.207.254:37841
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:32:56.530215 28858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:32:56.531674 28858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:32:56.546612 28863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:56.546646 28866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:56.546685 28864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:32:56.547497 28858 server_base.cc:1034] running on GCE node
I20260808 23:32:56.548290 28858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:32:56.549494 28858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:32:56.550779 28858 hybrid_clock.cc:648] HybridClock initialized: now 1786231976550694 us; error 47 us; skew 500 ppm
I20260808 23:32:56.551159 28858 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:32:56 dist-test-slave-1x4g krb5kdc[28594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231976, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:32:56.554920 28858 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:32:56.556596 28858 webserver.cc:460] Webserver started at http://127.26.207.194:38043/ using document root <none> and password file <none>
I20260808 23:32:56.557462 28858 fs_manager.cc:359] Metadata directory not provided
I20260808 23:32:56.557566 28858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:32:56.557857 28858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:32:56.561111 28858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "7def850e87d3418cb1bd2e26d816c3c7"
format_stamp: "Formatted at 2026-08-08 23:32:56 on dist-test-slave-1x4g"
server_key: "247eec3efbf19789aca2cde56806ff2a"
server_key_iv: "642aa49d02023fd3baf0f59c0b58f58a"
server_key_version: "encryptionkey@0"
I20260808 23:32:56.561997 28858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "7def850e87d3418cb1bd2e26d816c3c7"
format_stamp: "Formatted at 2026-08-08 23:32:56 on dist-test-slave-1x4g"
server_key: "247eec3efbf19789aca2cde56806ff2a"
server_key_iv: "642aa49d02023fd3baf0f59c0b58f58a"
server_key_version: "encryptionkey@0"
I20260808 23:32:56.568018 28858 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 23:32:56.572088 28873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:56.573850 28858 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:32:56.574056 28858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "7def850e87d3418cb1bd2e26d816c3c7"
format_stamp: "Formatted at 2026-08-08 23:32:56 on dist-test-slave-1x4g"
server_key: "247eec3efbf19789aca2cde56806ff2a"
server_key_iv: "642aa49d02023fd3baf0f59c0b58f58a"
server_key_version: "encryptionkey@0"
I20260808 23:32:56.574290 28858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:32:56.590240 28858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:32:56.595521 28858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:32:56.595777 28858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:32:56.598717 28858 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:32:56.598816 28858 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:56.598960 28858 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:32:56.599023 28858 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 23:32:56 dist-test-slave-1x4g krb5kdc[28594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231976, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:32:56.632066 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:56.600260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:37841 (local address 127.26.207.194:38023)
0808 23:32:56.601269 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:56.601323 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:56.603914 (+ 2591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:56.605070 (+ 1156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:56.605084 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:56.606058 (+ 974us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:32:56.607256 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:56.607300 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:56.608932 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:56.608941 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:56.611240 (+ 2299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:56.611276 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:56.612225 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:56.612232 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:56.612635 (+ 403us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:56.613863 (+ 1228us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:32:56.613922 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:32:56.618627 (+ 4705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:32:56.624029 (+ 5402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:56.624048 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:56.624076 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:56.625216 (+ 1140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:56.625930 (+ 714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:56.625935 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:56.625939 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:56.626327 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:56.627321 (+ 994us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:32:56.627333 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:32:56.628107 (+ 774us) client_negotiation.cc:769] Sending connection context
0808 23:32:56.628590 (+ 483us) client_negotiation.cc:240] Negotiation successful
0808 23:32:56.629545 (+ 955us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":697,"thread_start_us":450,"threads_started":1}
I20260808 23:32:56.633224 28738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:56.599627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:38023 (local address 127.26.207.254:37841)
0808 23:32:56.599845 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:56.599851 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:56.601493 (+ 1642us) server_negotiation.cc:407] Connection header received
0808 23:32:56.604389 (+ 2896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:56.604397 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:56.604544 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:56.604678 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:56.607612 (+ 2934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:56.608725 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:56.611466 (+ 2741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:56.611946 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:56.612106 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:56.619085 (+ 6979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:56.619095 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:56.619105 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:56.619152 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:56.623691 (+ 4539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:56.625484 (+ 1793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:56.625494 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:56.625500 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:56.625735 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:56.626569 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:56.626577 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:56.626583 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:56.627090 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:56.632103 (+ 5013us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:56.632352 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 23:32:56.632832 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 23:32:56.649142 28858 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:33339
I20260808 23:32:56.649155 28996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:33339 every 8 connection(s)
I20260808 23:32:56.650745 28858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:32:56.654034 28997 heartbeater.cc:347] Connected to a master server at 127.26.207.254:37841
I20260808 23:32:56.654330 28997 heartbeater.cc:464] Registering TS with master...
I20260808 23:32:56.655121 28997 heartbeater.cc:511] Master 127.26.207.254:37841 requested a full tablet report, sending...
I20260808 23:32:56.656682 28738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:56.640047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:60523 (local address 127.26.207.254:37841)
0808 23:32:56.640318 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:56.640327 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:56.641213 (+ 886us) server_negotiation.cc:407] Connection header received
0808 23:32:56.641686 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:56.641692 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:56.641807 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:56.641929 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:56.643012 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:56.644066 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:56.646214 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:56.646863 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:56.647021 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:56.649910 (+ 2889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:56.649917 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:56.649922 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:56.649965 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:56.653464 (+ 3499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:56.654393 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:56.654399 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:56.654403 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:56.654594 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:56.655008 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:56.655018 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:56.655021 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:56.655417 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:56.655600 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:56.656035 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 23:32:56.656291 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 23:32:56.656754 28981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:56.640095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:37841 (local address 127.26.207.194:60523)
0808 23:32:56.641074 (+ 979us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:56.641103 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:56.641314 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:56.641964 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:56.641969 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:56.642512 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:32:56.642833 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:56.642845 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:56.644253 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:56.644259 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:56.645987 (+ 1728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:56.646008 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:56.647098 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:56.647107 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:56.647294 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:56.648078 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:32:56.648121 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:32:56.649646 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:32:56.653612 (+ 3966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:56.653616 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:56.653619 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:56.654254 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:56.654715 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:56.654721 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:56.654725 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:56.654874 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:56.655550 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:32:56.655555 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:32:56.655770 (+ 215us) client_negotiation.cc:769] Sending connection context
0808 23:32:56.655912 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 23:32:56.656288 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"thread_start_us":431,"threads_started":1}
I20260808 23:32:56.656877 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 28858
I20260808 23:32:56.657088 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:32:56.656847 28639 ts_manager.cc:194] Registered new tserver with Master: 7def850e87d3418cb1bd2e26d816c3c7 (127.26.207.194:33339)
I20260808 23:32:56.657666 27455 external_mini_cluster.cc:1428] Setting key 0e54c614d1dbbda38688e7cf422cd500
I20260808 23:32:56.658335 28639 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:38023
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:32:56.709451 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:37841
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:39905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:32:57.079280 29001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:32:57.079639 29001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:32:57.079831 29001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:32:57.089046 29001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:32:57.089221 29001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:32:57.089365 29001 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 23:32:57.089502 29001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:32:57.101415 29001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:39905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.207.254:37841
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:32:57.102684 28854 heartbeater.cc:503] Master 127.26.207.254:37841 was elected leader, sending a full tablet report...
I20260808 23:32:57.103049 29001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:32:57.104988 29001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:32:57.121021 29006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:57.121047 29007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:32:57.121433 29009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:32:57.122068 29001 server_base.cc:1034] running on GCE node
I20260808 23:32:57.122859 29001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:32:57.123930 29001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:32:57.125202 29001 hybrid_clock.cc:648] HybridClock initialized: now 1786231977125109 us; error 63 us; skew 500 ppm
I20260808 23:32:57.125563 29001 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:32:57 dist-test-slave-1x4g krb5kdc[28594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231977, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:32:57.129215 29001 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:32:57.130901 29001 webserver.cc:460] Webserver started at http://127.26.207.195:35377/ using document root <none> and password file <none>
I20260808 23:32:57.131726 29001 fs_manager.cc:359] Metadata directory not provided
I20260808 23:32:57.131876 29001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:32:57.132246 29001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:32:57.135903 29001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "22cfe85e9009404fa0c417b59e64ea22"
format_stamp: "Formatted at 2026-08-08 23:32:57 on dist-test-slave-1x4g"
server_key: "cfee8b3b91957363cf9f2b1280b70479"
server_key_iv: "418eb88120e40feb0ec2230b026c256f"
server_key_version: "encryptionkey@0"
I20260808 23:32:57.136992 29001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "22cfe85e9009404fa0c417b59e64ea22"
format_stamp: "Formatted at 2026-08-08 23:32:57 on dist-test-slave-1x4g"
server_key: "cfee8b3b91957363cf9f2b1280b70479"
server_key_iv: "418eb88120e40feb0ec2230b026c256f"
server_key_version: "encryptionkey@0"
I20260808 23:32:57.143126 29001 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 23:32:57.147534 29017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:32:57.149266 29001 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:32:57.149492 29001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "22cfe85e9009404fa0c417b59e64ea22"
format_stamp: "Formatted at 2026-08-08 23:32:57 on dist-test-slave-1x4g"
server_key: "cfee8b3b91957363cf9f2b1280b70479"
server_key_iv: "418eb88120e40feb0ec2230b026c256f"
server_key_version: "encryptionkey@0"
I20260808 23:32:57.149782 29001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:32:57.175678 29001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:32:57.181496 29001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:32:57.181816 29001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:32:57.184705 29001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:32:57.184871 29001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 23:32:57.185082 29001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:32:57.185163 29001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 23:32:57 dist-test-slave-1x4g krb5kdc[28594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231977, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:32:57.216405 29029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.185637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:53013 (local address 127.26.207.254:37841)
0808 23:32:57.186209 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:57.186216 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:57.187697 (+ 1481us) server_negotiation.cc:407] Connection header received
0808 23:32:57.191190 (+ 3493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:57.191200 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:57.191328 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:57.191494 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:57.194780 (+ 3286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.195854 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.199431 (+ 3577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.200065 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.200266 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.206601 (+ 6335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:57.206610 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:57.206618 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:57.206679 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:57.212100 (+ 5421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:57.213601 (+ 1501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:57.213606 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:57.213609 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:57.213779 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:57.214326 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:57.214330 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:57.214332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:57.214663 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:57.214841 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:57.215680 (+ 839us) server_negotiation.cc:299] Negotiation successful
0808 23:32:57.215968 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":295,"threads_started":1}
I20260808 23:32:57.218240 29030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.186441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:37841 (local address 127.26.207.195:53013)
0808 23:32:57.187468 (+ 1027us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:57.187540 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:57.190708 (+ 3168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:57.191867 (+ 1159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:57.191897 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:57.193169 (+ 1272us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:32:57.194455 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.194505 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.196081 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.196089 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.199155 (+ 3066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.199187 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.200455 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.200465 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.200986 (+ 521us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.202064 (+ 1078us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:32:57.202110 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:32:57.206194 (+ 4084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:32:57.212399 (+ 6205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:57.212410 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:57.212440 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:57.213318 (+ 878us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:57.213913 (+ 595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:57.213918 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:57.213930 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:57.214177 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:57.214811 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:32:57.214821 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:32:57.215260 (+ 439us) client_negotiation.cc:769] Sending connection context
0808 23:32:57.215560 (+ 300us) client_negotiation.cc:240] Negotiation successful
0808 23:32:57.216242 (+ 682us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":365,"threads_started":1}
I20260808 23:32:57.253245 29029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.228047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:56917 (local address 127.26.207.254:37841)
0808 23:32:57.228231 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:57.228236 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:57.230159 (+ 1923us) server_negotiation.cc:407] Connection header received
0808 23:32:57.230419 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:57.230424 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:57.230601 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:57.230774 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:57.234159 (+ 3385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.235587 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.238909 (+ 3322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.239799 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.240039 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.244145 (+ 4106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:57.244156 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:57.244162 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:57.244218 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:57.248418 (+ 4200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:57.249711 (+ 1293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:57.249726 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:57.249733 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:57.250027 (+ 294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:57.250714 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:57.250722 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:57.250728 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:57.251301 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:57.251569 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:57.252361 (+ 792us) server_negotiation.cc:299] Negotiation successful
0808 23:32:57.252700 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 23:32:57.253512 29107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.228325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:37841 (local address 127.26.207.195:56917)
0808 23:32:57.230021 (+ 1696us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:57.230042 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:57.230244 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:57.230902 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:57.230908 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:57.232409 (+ 1501us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:32:57.233798 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.233829 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.235816 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.235827 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.238654 (+ 2827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.238688 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.240250 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.240262 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.240676 (+ 414us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.241657 (+ 981us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:32:57.241693 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:32:57.243629 (+ 1936us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:32:57.248611 (+ 4982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:57.248617 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:57.248621 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:57.249447 (+ 826us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:57.250173 (+ 726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:57.250180 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:57.250189 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:57.250536 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:57.251474 (+ 938us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:32:57.251481 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:32:57.251982 (+ 501us) client_negotiation.cc:769] Sending connection context
0808 23:32:57.252234 (+ 252us) client_negotiation.cc:240] Negotiation successful
0808 23:32:57.252747 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1437,"thread_start_us":996,"threads_started":1}
I20260808 23:32:57.264425 29001 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:39505
I20260808 23:32:57.264453 29145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:39505 every 8 connection(s)
I20260808 23:32:57.265952 29001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:32:57.268646 29147 heartbeater.cc:347] Connected to a master server at 127.26.207.254:37841
I20260808 23:32:57.268983 29147 heartbeater.cc:464] Registering TS with master...
I20260808 23:32:57.269766 29147 heartbeater.cc:511] Master 127.26.207.254:37841 requested a full tablet report, sending...
I20260808 23:32:57.271461 28639 ts_manager.cc:194] Registered new tserver with Master: 22cfe85e9009404fa0c417b59e64ea22 (127.26.207.195:39505)
I20260808 23:32:57.272619 28639 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:53013
I20260808 23:32:57.275297 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 29001
I20260808 23:32:57.275601 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:32:57.276199 27455 external_mini_cluster.cc:1428] Setting key e5c4a111bbbf5949e5b50138aa9d2e53
I20260808 23:32:57.280354 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 23:32:57 dist-test-slave-1x4g krb5kdc[28594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231977, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 23:32:57 dist-test-slave-1x4g krb5kdc[28594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231977, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:32:57.342581 29029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.324124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36898 (local address 127.26.207.254:37841)
0808 23:32:57.324402 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:57.324409 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:57.324760 (+ 351us) server_negotiation.cc:407] Connection header received
0808 23:32:57.325038 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:57.325045 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:57.325143 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:57.325258 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:57.327302 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.328200 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.329721 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.330239 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.330388 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.335873 (+ 5485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:57.335879 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:57.335883 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:57.335933 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:57.339015 (+ 3082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:57.339989 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:57.339994 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:57.339997 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:57.340245 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:57.340706 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:57.340709 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:57.340711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:57.341172 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:57.341583 (+ 411us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:57.341867 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 23:32:57.342074 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 23:32:57.348263 28639 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36898:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:32:57.356998 28639 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:32:57.396160 29160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.374349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51714 (local address 127.26.207.195:39505)
0808 23:32:57.375693 (+ 1344us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:57.375709 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:57.378692 (+ 2983us) server_negotiation.cc:407] Connection header received
0808 23:32:57.379410 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:57.379425 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:57.379917 (+ 492us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:57.380194 (+ 277us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:32:57.382467 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.385563 (+ 3096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.390907 (+ 5344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.393375 (+ 2468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.393750 (+ 375us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.394036 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:57.395150 (+ 1114us) server_negotiation.cc:299] Negotiation successful
0808 23:32:57.395561 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1033,"thread_start_us":1370,"threads_started":1}
I20260808 23:32:57.396221 29167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.374391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:39505 (local address 127.0.0.1:51714)
0808 23:32:57.378355 (+ 3964us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:57.378500 (+ 145us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:57.379020 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:57.381240 (+ 2220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:57.381253 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:57.381311 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:32:57.382059 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.382080 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.385901 (+ 3821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.385911 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.390621 (+ 4710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.390639 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.394287 (+ 3648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.394295 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.394741 (+ 446us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.394831 (+ 90us) client_negotiation.cc:769] Sending connection context
0808 23:32:57.395029 (+ 198us) client_negotiation.cc:240] Negotiation successful
0808 23:32:57.395258 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3586,"thread_start_us":15484,"threads_started":1}
I20260808 23:32:57.401185 29164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.374908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:33339 (local address 127.0.0.1:58228)
0808 23:32:57.389606 (+ 14698us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:57.389643 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:57.390107 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:57.391128 (+ 1021us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:57.391146 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:57.391175 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:32:57.392193 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.392226 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.394293 (+ 2067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.394296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.397656 (+ 3360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.397673 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.399902 (+ 2229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.399911 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.400103 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.400154 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 23:32:57.400275 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 23:32:57.400460 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14303,"mutex_wait_us":32,"thread_start_us":14042,"threads_started":1}
I20260808 23:32:57.401515 29166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.375552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58228 (local address 127.26.207.194:33339)
0808 23:32:57.376456 (+ 904us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:57.376469 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:57.389862 (+ 13393us) server_negotiation.cc:407] Connection header received
0808 23:32:57.390524 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:57.390545 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:57.390873 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:57.391188 (+ 315us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:32:57.392536 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.394101 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.397919 (+ 3818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.399556 (+ 1637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.399848 (+ 292us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.400064 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:57.400413 (+ 349us) server_negotiation.cc:299] Negotiation successful
0808 23:32:57.400621 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":519,"threads_started":1}
I20260808 23:32:57.402812 29072 tablet_service.cc:1467] Processing CreateTablet for tablet 68db7ece10a141889540b8d7bc9e569e (DEFAULT_TABLE table=test-table [id=b4afe7819a7d4ce7b348619f0491b7de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:32:57.404891 29163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.374908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:38051 (local address 127.0.0.1:36110)
0808 23:32:57.390428 (+ 15520us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:57.390443 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:57.390627 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:57.391741 (+ 1114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:57.391746 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:57.391797 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:32:57.393870 (+ 2073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.393886 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.396742 (+ 2856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.396747 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.400730 (+ 3983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.400749 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.403674 (+ 2925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.403683 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.403919 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.403960 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 23:32:57.404069 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 23:32:57.404240 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15295,"mutex_wait_us":1044,"thread_start_us":1753,"threads_started":1}
I20260808 23:32:57.405261 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.375467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36110 (local address 127.26.207.193:38051)
0808 23:32:57.377497 (+ 2030us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:57.377510 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:57.390571 (+ 13061us) server_negotiation.cc:407] Connection header received
0808 23:32:57.390790 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:57.390796 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:57.391089 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:57.391366 (+ 277us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:32:57.394186 (+ 2820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.396443 (+ 2257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.401063 (+ 4620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.403291 (+ 2228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.403566 (+ 275us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.403772 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:57.404569 (+ 797us) server_negotiation.cc:299] Negotiation successful
0808 23:32:57.404825 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1787,"thread_start_us":1612,"threads_started":1}
I20260808 23:32:57.405377 29072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68db7ece10a141889540b8d7bc9e569e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:32:57.407377 28924 tablet_service.cc:1467] Processing CreateTablet for tablet 68db7ece10a141889540b8d7bc9e569e (DEFAULT_TABLE table=test-table [id=b4afe7819a7d4ce7b348619f0491b7de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:32:57.409781 28924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68db7ece10a141889540b8d7bc9e569e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:32:57.414295 28780 tablet_service.cc:1467] Processing CreateTablet for tablet 68db7ece10a141889540b8d7bc9e569e (DEFAULT_TABLE table=test-table [id=b4afe7819a7d4ce7b348619f0491b7de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:32:57.418627 28780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68db7ece10a141889540b8d7bc9e569e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:32:57.433702 29168 tablet_bootstrap.cc:492] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22: Bootstrap starting.
I20260808 23:32:57.436005 29169 tablet_bootstrap.cc:492] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7: Bootstrap starting.
I20260808 23:32:57.440109 29169 tablet_bootstrap.cc:654] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7: Neither blocks nor log segments found. Creating new log.
I20260808 23:32:57.441685 29170 tablet_bootstrap.cc:492] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe: Bootstrap starting.
I20260808 23:32:57.441785 29169 log.cc:824] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7: Log is configured to *not* fsync() on all Append() calls
I20260808 23:32:57.445942 29170 tablet_bootstrap.cc:654] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe: Neither blocks nor log segments found. Creating new log.
I20260808 23:32:57.446435 29168 tablet_bootstrap.cc:654] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22: Neither blocks nor log segments found. Creating new log.
I20260808 23:32:57.447412 29170 log.cc:824] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe: Log is configured to *not* fsync() on all Append() calls
I20260808 23:32:57.447830 29168 log.cc:824] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22: Log is configured to *not* fsync() on all Append() calls
I20260808 23:32:57.449251 29169 tablet_bootstrap.cc:492] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7: No bootstrap required, opened a new log
I20260808 23:32:57.449790 29169 ts_tablet_manager.cc:1397] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.000s
I20260808 23:32:57.451143 29170 tablet_bootstrap.cc:492] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe: No bootstrap required, opened a new log
I20260808 23:32:57.451996 29170 ts_tablet_manager.cc:1397] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260808 23:32:57.454622 29168 tablet_bootstrap.cc:492] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22: No bootstrap required, opened a new log
I20260808 23:32:57.455190 29168 ts_tablet_manager.cc:1397] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22: Time spent bootstrapping tablet: real 0.022s user 0.013s sys 0.000s
I20260808 23:32:57.459527 29169 raft_consensus.cc:348] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } }
I20260808 23:32:57.459983 29169 raft_consensus.cc:374] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:32:57.460227 29169 raft_consensus.cc:729] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7def850e87d3418cb1bd2e26d816c3c7, State: Initialized, Role: FOLLOWER
I20260808 23:32:57.461077 29169 consensus_queue.cc:260] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } }
I20260808 23:32:57.462415 28997 heartbeater.cc:503] Master 127.26.207.254:37841 was elected leader, sending a full tablet report...
I20260808 23:32:57.463287 29169 ts_tablet_manager.cc:1428] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260808 23:32:57.466459 29170 raft_consensus.cc:348] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } }
I20260808 23:32:57.467114 29170 raft_consensus.cc:374] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:32:57.467250 29170 raft_consensus.cc:729] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fe5fcb21a1549f1bb985eaed377bdbe, State: Initialized, Role: FOLLOWER
I20260808 23:32:57.468195 29170 consensus_queue.cc:260] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } }
I20260808 23:32:57.469089 29168 raft_consensus.cc:348] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } }
I20260808 23:32:57.469863 29168 raft_consensus.cc:374] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:32:57.470026 29168 raft_consensus.cc:729] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22cfe85e9009404fa0c417b59e64ea22, State: Initialized, Role: FOLLOWER
I20260808 23:32:57.470845 29168 consensus_queue.cc:260] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } }
I20260808 23:32:57.471354 29170 ts_tablet_manager.cc:1428] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe: Time spent starting tablet: real 0.019s user 0.004s sys 0.014s
I20260808 23:32:57.472913 29147 heartbeater.cc:503] Master 127.26.207.254:37841 was elected leader, sending a full tablet report...
I20260808 23:32:57.473676 29168 ts_tablet_manager.cc:1428] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22: Time spent starting tablet: real 0.018s user 0.013s sys 0.004s
W20260808 23:32:57.518370 29148 tablet.cc:2369] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:32:57.541638 29175 raft_consensus.cc:482] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:32:57.542156 29175 raft_consensus.cc:504] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } }
I20260808 23:32:57.544379 29175 leader_election.cc:288] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22cfe85e9009404fa0c417b59e64ea22 (127.26.207.195:39505), 7def850e87d3418cb1bd2e26d816c3c7 (127.26.207.194:33339)
I20260808 23:32:57.551831 29160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.545374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:44961 (local address 127.26.207.195:39505)
0808 23:32:57.545676 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:57.545683 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:57.545703 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:32:57.545900 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:57.545906 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:57.545980 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:57.546075 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:32:57.546814 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.547577 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.549969 (+ 2392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.550801 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.551006 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.551118 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:57.551403 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 23:32:57.551555 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260808 23:32:57.552093 29177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.544595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:39505 (local address 127.26.207.193:44961)
0808 23:32:57.545455 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:57.545477 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:57.545719 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:57.546100 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:57.546104 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:57.546131 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:32:57.546656 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.546668 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.547715 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.547721 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.549775 (+ 2054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.549791 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.551048 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.551054 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.551233 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.551258 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 23:32:57.551372 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 23:32:57.551522 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"mutex_wait_us":55,"thread_start_us":450,"threads_started":1}
I20260808 23:32:57.552150 29166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.545107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:35383 (local address 127.26.207.194:33339)
0808 23:32:57.545475 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:57.545482 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:57.546123 (+ 641us) server_negotiation.cc:407] Connection header received
0808 23:32:57.546344 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:57.546349 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:57.546422 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:57.546546 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:32:57.547327 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.548099 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.550163 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.550968 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.551294 (+ 326us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.551392 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:57.551720 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 23:32:57.551863 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173}
I20260808 23:32:57.552485 29178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.544889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:33339 (local address 127.26.207.193:35383)
0808 23:32:57.546011 (+ 1122us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:57.546027 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:57.546204 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:57.546561 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:57.546566 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:57.546594 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:32:57.547162 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.547174 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.548252 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.548257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.549983 (+ 1726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.549997 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.551295 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.551305 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.551485 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.551510 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 23:32:57.551638 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 23:32:57.551784 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":963,"mutex_wait_us":70,"thread_start_us":760,"threads_started":1}
I20260808 23:32:57.553321 29174 raft_consensus.cc:482] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:32:57.553645 29092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68db7ece10a141889540b8d7bc9e569e" candidate_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22cfe85e9009404fa0c417b59e64ea22" is_pre_election: true
I20260808 23:32:57.553690 29174 raft_consensus.cc:504] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } }
I20260808 23:32:57.554350 29092 raft_consensus.cc:2454] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fe5fcb21a1549f1bb985eaed377bdbe in term 0.
I20260808 23:32:57.554170 28945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68db7ece10a141889540b8d7bc9e569e" candidate_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7def850e87d3418cb1bd2e26d816c3c7" is_pre_election: true
I20260808 23:32:57.554837 28945 raft_consensus.cc:2454] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fe5fcb21a1549f1bb985eaed377bdbe in term 0.
I20260808 23:32:57.555382 28730 leader_election.cc:302] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22cfe85e9009404fa0c417b59e64ea22, 4fe5fcb21a1549f1bb985eaed377bdbe; no voters:
I20260808 23:32:57.555903 29174 leader_election.cc:288] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22cfe85e9009404fa0c417b59e64ea22 (127.26.207.195:39505), 4fe5fcb21a1549f1bb985eaed377bdbe (127.26.207.193:38051)
I20260808 23:32:57.556167 29175 raft_consensus.cc:2781] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:32:57.556350 29175 raft_consensus.cc:482] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:32:57.556505 29175 raft_consensus.cc:3037] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:32:57.559152 29175 raft_consensus.cc:504] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } }
I20260808 23:32:57.559824 29175 leader_election.cc:288] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [CANDIDATE]: Term 1 election: Requested vote from peers 22cfe85e9009404fa0c417b59e64ea22 (127.26.207.195:39505), 7def850e87d3418cb1bd2e26d816c3c7 (127.26.207.194:33339)
I20260808 23:32:57.560405 29092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68db7ece10a141889540b8d7bc9e569e" candidate_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22cfe85e9009404fa0c417b59e64ea22"
I20260808 23:32:57.560717 29092 raft_consensus.cc:3037] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:32:57.564764 29092 raft_consensus.cc:2454] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fe5fcb21a1549f1bb985eaed377bdbe in term 1.
I20260808 23:32:57.565532 28730 leader_election.cc:302] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22cfe85e9009404fa0c417b59e64ea22, 4fe5fcb21a1549f1bb985eaed377bdbe; no voters:
I20260808 23:32:57.565855 28945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68db7ece10a141889540b8d7bc9e569e" candidate_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7def850e87d3418cb1bd2e26d816c3c7"
I20260808 23:32:57.566037 29175 raft_consensus.cc:2781] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:32:57.566403 28945 raft_consensus.cc:3037] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:32:57.567909 29175 raft_consensus.cc:686] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 1 LEADER]: Becoming Leader. State: Replica: 4fe5fcb21a1549f1bb985eaed377bdbe, State: Running, Role: LEADER
I20260808 23:32:57.568638 29175 consensus_queue.cc:237] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } }
I20260808 23:32:57.571744 28945 raft_consensus.cc:2454] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fe5fcb21a1549f1bb985eaed377bdbe in term 1.
I20260808 23:32:57.572131 29160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.556659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:56123 (local address 127.26.207.195:39505)
0808 23:32:57.560451 (+ 3792us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:57.560457 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:57.561460 (+ 1003us) server_negotiation.cc:407] Connection header received
0808 23:32:57.561763 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:57.561770 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:57.561846 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:57.561917 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:32:57.562986 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.564351 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.568666 (+ 4315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.570351 (+ 1685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.570511 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.570587 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:57.571370 (+ 783us) server_negotiation.cc:299] Negotiation successful
0808 23:32:57.571570 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3634}
I20260808 23:32:57.573576 29179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.556084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:39505 (local address 127.26.207.194:56123)
0808 23:32:57.561332 (+ 5248us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:57.561357 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:57.561598 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:57.562128 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:57.562132 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:57.562162 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:32:57.562798 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.562813 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.564578 (+ 1765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.564586 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.568365 (+ 3779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.568390 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.570934 (+ 2544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.570941 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.571129 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.571164 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 23:32:57.572511 (+ 1347us) client_negotiation.cc:240] Negotiation successful
0808 23:32:57.572729 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5065,"thread_start_us":4773,"threads_started":1}
I20260808 23:32:57.574906 29092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68db7ece10a141889540b8d7bc9e569e" candidate_uuid: "7def850e87d3418cb1bd2e26d816c3c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22cfe85e9009404fa0c417b59e64ea22" is_pre_election: true
I20260808 23:32:57.575515 29092 raft_consensus.cc:2379] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7def850e87d3418cb1bd2e26d816c3c7 in current term 1: Already voted for candidate 4fe5fcb21a1549f1bb985eaed377bdbe in this term.
I20260808 23:32:57.576911 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.556547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:56383 (local address 127.26.207.193:38051)
0808 23:32:57.556932 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:57.556941 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:57.565681 (+ 8740us) server_negotiation.cc:407] Connection header received
0808 23:32:57.566015 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:57.566027 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:57.566113 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:57.566233 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:32:57.568991 (+ 2758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.570466 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.573548 (+ 3082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.575292 (+ 1744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.575484 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.575589 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:57.576436 (+ 847us) server_negotiation.cc:299] Negotiation successful
0808 23:32:57.576584 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 23:32:57.577858 29181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.556105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:38051 (local address 127.26.207.194:56383)
0808 23:32:57.565555 (+ 9450us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:57.565576 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:57.565808 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:57.566503 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:57.566508 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:57.566539 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:32:57.567400 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.567419 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.570823 (+ 3404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.570829 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.573354 (+ 2525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.573373 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.575908 (+ 2535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.575916 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.576218 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.576261 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 23:32:57.577178 (+ 917us) client_negotiation.cc:240] Negotiation successful
0808 23:32:57.577361 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9272,"thread_start_us":9057,"threads_started":1}
I20260808 23:32:57.577966 28639 catalog_manager.cc:5495] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4fe5fcb21a1549f1bb985eaed377bdbe (127.26.207.193). New cstate: current_term: 1 leader_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } health_report { overall_health: UNKNOWN } } }
I20260808 23:32:57.578783 28802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68db7ece10a141889540b8d7bc9e569e" candidate_uuid: "7def850e87d3418cb1bd2e26d816c3c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" is_pre_election: true
I20260808 23:32:57.579857 28877 leader_election.cc:302] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7def850e87d3418cb1bd2e26d816c3c7; no voters: 22cfe85e9009404fa0c417b59e64ea22, 4fe5fcb21a1549f1bb985eaed377bdbe
I20260808 23:32:57.580389 29174 raft_consensus.cc:2726] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260808 23:32:57.592427 28855 tablet.cc:2369] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:32:57.653379 28998 tablet.cc:2369] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:32:57.658433 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.649550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36122 (local address 127.26.207.193:38051)
0808 23:32:57.649817 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:57.649827 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:57.649980 (+ 153us) server_negotiation.cc:407] Connection header received
0808 23:32:57.650394 (+ 414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:57.650399 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:57.650481 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:57.650613 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:32:57.651272 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.652101 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.654600 (+ 2499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.655268 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.655559 (+ 291us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.656384 (+ 825us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:32:57.657350 (+ 966us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:32:57.657508 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:57.657735 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 23:32:57.657898 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260808 23:32:57.670506 28945 raft_consensus.cc:1261] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7 [term 1 FOLLOWER]: Refusing update from remote peer 4fe5fcb21a1549f1bb985eaed377bdbe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:32:57.671466 29092 raft_consensus.cc:1261] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22 [term 1 FOLLOWER]: Refusing update from remote peer 4fe5fcb21a1549f1bb985eaed377bdbe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:32:57.671895 29182 consensus_queue.cc:1035] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260808 23:32:57.672649 29175 consensus_queue.cc:1035] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [LEADER]: Connected to new peer: Peer: permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:32:57.692605 29185 mvcc.cc:205] Tried to move back new op lower bound from 7316406180521652224 to 7316406180127232000. Current Snapshot: MvccSnapshot[applied={T|T < 7316406180521652224}]
I20260808 23:32:57.724493 28638 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:32:57.725062 28638 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:32:57.730695 28638 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41: Sending DeleteTablet for 3 replicas of tablet 68db7ece10a141889540b8d7bc9e569e
I20260808 23:32:57.732589 28780 tablet_service.cc:1514] Processing DeleteTablet for tablet 68db7ece10a141889540b8d7bc9e569e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:32:57 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:36110
I20260808 23:32:57.733151 28924 tablet_service.cc:1514] Processing DeleteTablet for tablet 68db7ece10a141889540b8d7bc9e569e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:32:57 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:58228
I20260808 23:32:57.734697 29072 tablet_service.cc:1514] Processing DeleteTablet for tablet 68db7ece10a141889540b8d7bc9e569e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:32:57 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:51714
I20260808 23:32:57.735683 28638 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36898:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:32:57.737088 28638 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:32:57.739840 29198 tablet_replica.cc:330] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22: stopping tablet replica
I20260808 23:32:57.740926 29198 raft_consensus.cc:2229] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:32:57.741977 29198 raft_consensus.cc:2258] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:32:57.745481 29198 ts_tablet_manager.cc:1905] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:32:57.755221 29072 tablet_service.cc:1467] Processing CreateTablet for tablet 36f1cff8995e4353a8ccde4d8f0a469e (DEFAULT_TABLE table=test-table [id=46b33d5796c4421ead5a667152db5625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:32:57.755851 29072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36f1cff8995e4353a8ccde4d8f0a469e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:32:57.755829 28923 tablet_service.cc:1467] Processing CreateTablet for tablet 36f1cff8995e4353a8ccde4d8f0a469e (DEFAULT_TABLE table=test-table [id=46b33d5796c4421ead5a667152db5625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:32:57.756680 28923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36f1cff8995e4353a8ccde4d8f0a469e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:32:57.757308 29198 ts_tablet_manager.cc:1918] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:32:57.757730 29198 log.cc:1196] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/68db7ece10a141889540b8d7bc9e569e
I20260808 23:32:57.758795 29198 ts_tablet_manager.cc:1939] T 68db7ece10a141889540b8d7bc9e569e P 22cfe85e9009404fa0c417b59e64ea22: Deleting consensus metadata
I20260808 23:32:57.761678 28624 catalog_manager.cc:4841] TS 22cfe85e9009404fa0c417b59e64ea22 (127.26.207.195:39505): tablet 68db7ece10a141889540b8d7bc9e569e (table test-table [id=b4afe7819a7d4ce7b348619f0491b7de]) successfully deleted
I20260808 23:32:57.763566 28779 tablet_service.cc:1467] Processing CreateTablet for tablet 36f1cff8995e4353a8ccde4d8f0a469e (DEFAULT_TABLE table=test-table [id=46b33d5796c4421ead5a667152db5625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:32:57.765336 29168 tablet_bootstrap.cc:492] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22: Bootstrap starting.
I20260808 23:32:57.764724 28779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36f1cff8995e4353a8ccde4d8f0a469e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:32:57.767673 29195 tablet_replica.cc:330] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7: stopping tablet replica
I20260808 23:32:57.768189 29168 tablet_bootstrap.cc:654] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22: Neither blocks nor log segments found. Creating new log.
I20260808 23:32:57.768324 29195 raft_consensus.cc:2229] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:32:57.769148 29195 raft_consensus.cc:2258] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:32:57.769892 29169 tablet_bootstrap.cc:492] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7: Bootstrap starting.
I20260808 23:32:57.772709 29169 tablet_bootstrap.cc:654] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7: Neither blocks nor log segments found. Creating new log.
I20260808 23:32:57.774343 29195 ts_tablet_manager.cc:1905] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:32:57.781745 29169 tablet_bootstrap.cc:492] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7: No bootstrap required, opened a new log
I20260808 23:32:57.782079 29169 ts_tablet_manager.cc:1397] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.008s
I20260808 23:32:57.783281 29168 tablet_bootstrap.cc:492] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22: No bootstrap required, opened a new log
I20260808 23:32:57.783195 29169 raft_consensus.cc:348] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.783529 29197 tablet_replica.cc:330] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe: stopping tablet replica
I20260808 23:32:57.783548 29168 ts_tablet_manager.cc:1397] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.005s
I20260808 23:32:57.783748 29169 raft_consensus.cc:374] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:32:57.784015 29169 raft_consensus.cc:729] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7def850e87d3418cb1bd2e26d816c3c7, State: Initialized, Role: FOLLOWER
I20260808 23:32:57.784077 29197 raft_consensus.cc:2229] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:32:57.784513 29168 raft_consensus.cc:348] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.784842 29168 raft_consensus.cc:374] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:32:57.784587 29169 consensus_queue.cc:260] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.784965 29168 raft_consensus.cc:729] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22cfe85e9009404fa0c417b59e64ea22, State: Initialized, Role: FOLLOWER
I20260808 23:32:57.785039 29197 raft_consensus.cc:2258] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:32:57.785463 29170 tablet_bootstrap.cc:492] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe: Bootstrap starting.
I20260808 23:32:57.786895 29169 ts_tablet_manager.cc:1428] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260808 23:32:57.787513 29170 tablet_bootstrap.cc:654] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe: Neither blocks nor log segments found. Creating new log.
I20260808 23:32:57.789381 29197 ts_tablet_manager.cc:1905] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:32:57.792856 29168 consensus_queue.cc:260] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.793730 29168 ts_tablet_manager.cc:1428] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22: Time spent starting tablet: real 0.010s user 0.000s sys 0.003s
I20260808 23:32:57.797837 29195 ts_tablet_manager.cc:1918] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:32:57.798173 29195 log.cc:1196] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/68db7ece10a141889540b8d7bc9e569e
I20260808 23:32:57.798943 29195 ts_tablet_manager.cc:1939] T 68db7ece10a141889540b8d7bc9e569e P 7def850e87d3418cb1bd2e26d816c3c7: Deleting consensus metadata
I20260808 23:32:57.800767 29197 ts_tablet_manager.cc:1918] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:32:57.801106 29197 log.cc:1196] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/68db7ece10a141889540b8d7bc9e569e
I20260808 23:32:57.801314 28625 catalog_manager.cc:4841] TS 7def850e87d3418cb1bd2e26d816c3c7 (127.26.207.194:33339): tablet 68db7ece10a141889540b8d7bc9e569e (table test-table [id=b4afe7819a7d4ce7b348619f0491b7de]) successfully deleted
I20260808 23:32:57.801878 29197 ts_tablet_manager.cc:1939] T 68db7ece10a141889540b8d7bc9e569e P 4fe5fcb21a1549f1bb985eaed377bdbe: Deleting consensus metadata
I20260808 23:32:57.802312 29170 tablet_bootstrap.cc:492] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe: No bootstrap required, opened a new log
I20260808 23:32:57.802506 29170 ts_tablet_manager.cc:1397] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.012s
I20260808 23:32:57.803541 29170 raft_consensus.cc:348] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.803923 29170 raft_consensus.cc:374] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:32:57.804004 28626 catalog_manager.cc:4841] TS 4fe5fcb21a1549f1bb985eaed377bdbe (127.26.207.193:38051): tablet 68db7ece10a141889540b8d7bc9e569e (table test-table [id=b4afe7819a7d4ce7b348619f0491b7de]) successfully deleted
I20260808 23:32:57.804083 29170 raft_consensus.cc:729] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fe5fcb21a1549f1bb985eaed377bdbe, State: Initialized, Role: FOLLOWER
I20260808 23:32:57.804368 29170 consensus_queue.cc:260] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.805079 29170 ts_tablet_manager.cc:1428] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260808 23:32:57.820909 29176 raft_consensus.cc:482] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:32:57.821237 29176 raft_consensus.cc:504] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.823351 29176 leader_election.cc:288] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4fe5fcb21a1549f1bb985eaed377bdbe (127.26.207.193:38051), 7def850e87d3418cb1bd2e26d816c3c7 (127.26.207.194:33339)
I20260808 23:32:57.831903 29166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.824186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:59749 (local address 127.26.207.194:33339)
0808 23:32:57.824430 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:57.824439 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:57.824712 (+ 273us) server_negotiation.cc:407] Connection header received
0808 23:32:57.825036 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:57.825043 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:57.825134 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:57.825198 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:32:57.826048 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.827024 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.829482 (+ 2458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.830815 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.831007 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.831092 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:57.831465 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 23:32:57.831608 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 23:32:57.832033 29203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.823636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:33339 (local address 127.26.207.195:59749)
0808 23:32:57.824609 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:57.824630 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:57.824830 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:57.825416 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:57.825432 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:57.825460 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:32:57.825761 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.825777 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.827169 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.827175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.829273 (+ 2098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.829294 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.831034 (+ 1740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.831041 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.831258 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.831304 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 23:32:57.831433 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 23:32:57.831588 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":820,"mutex_wait_us":36,"thread_start_us":787,"threads_started":1}
I20260808 23:32:57.832366 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.823881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:39139 (local address 127.26.207.193:38051)
0808 23:32:57.824097 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:57.824104 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:57.825347 (+ 1243us) server_negotiation.cc:407] Connection header received
0808 23:32:57.825560 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:57.825564 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:57.825627 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:57.825728 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:32:57.826408 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.827624 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.830042 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.830995 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.831176 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.831257 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:57.831846 (+ 589us) server_negotiation.cc:299] Negotiation successful
0808 23:32:57.832033 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 23:32:57.832963 28945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36f1cff8995e4353a8ccde4d8f0a469e" candidate_uuid: "22cfe85e9009404fa0c417b59e64ea22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7def850e87d3418cb1bd2e26d816c3c7" is_pre_election: true
I20260808 23:32:57.833249 28945 raft_consensus.cc:2454] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22cfe85e9009404fa0c417b59e64ea22 in term 0.
I20260808 23:32:57.833276 29202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.823646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:38051 (local address 127.26.207.195:39139)
0808 23:32:57.825224 (+ 1578us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:57.825239 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:57.825395 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:57.825754 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:57.825758 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:57.825785 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:32:57.826216 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.826229 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.827777 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.827782 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.829860 (+ 2078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.829874 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.831427 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.831435 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.831631 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.831668 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 23:32:57.832669 (+ 1001us) client_negotiation.cc:240] Negotiation successful
0808 23:32:57.832876 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1478,"mutex_wait_us":35,"thread_start_us":1248,"threads_started":1}
I20260808 23:32:57.833982 29022 leader_election.cc:302] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22cfe85e9009404fa0c417b59e64ea22, 7def850e87d3418cb1bd2e26d816c3c7; no voters:
I20260808 23:32:57.834053 28802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36f1cff8995e4353a8ccde4d8f0a469e" candidate_uuid: "22cfe85e9009404fa0c417b59e64ea22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" is_pre_election: true
I20260808 23:32:57.834410 28802 raft_consensus.cc:2454] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22cfe85e9009404fa0c417b59e64ea22 in term 0.
I20260808 23:32:57.834486 29176 raft_consensus.cc:2781] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:32:57.834640 29176 raft_consensus.cc:482] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:32:57.834766 29176 raft_consensus.cc:3037] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:32:57.837610 29176 raft_consensus.cc:504] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.838853 29176 leader_election.cc:288] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [CANDIDATE]: Term 1 election: Requested vote from peers 4fe5fcb21a1549f1bb985eaed377bdbe (127.26.207.193:38051), 7def850e87d3418cb1bd2e26d816c3c7 (127.26.207.194:33339)
I20260808 23:32:57.839411 28802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36f1cff8995e4353a8ccde4d8f0a469e" candidate_uuid: "22cfe85e9009404fa0c417b59e64ea22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe"
I20260808 23:32:57.839510 28945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36f1cff8995e4353a8ccde4d8f0a469e" candidate_uuid: "22cfe85e9009404fa0c417b59e64ea22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7def850e87d3418cb1bd2e26d816c3c7"
I20260808 23:32:57.839684 28802 raft_consensus.cc:3037] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:32:57.839766 28945 raft_consensus.cc:3037] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:32:57.842589 28802 raft_consensus.cc:2454] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22cfe85e9009404fa0c417b59e64ea22 in term 1.
I20260808 23:32:57.843120 28945 raft_consensus.cc:2454] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22cfe85e9009404fa0c417b59e64ea22 in term 1.
I20260808 23:32:57.843433 29023 leader_election.cc:302] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22cfe85e9009404fa0c417b59e64ea22, 4fe5fcb21a1549f1bb985eaed377bdbe; no voters:
I20260808 23:32:57.843952 29176 raft_consensus.cc:2781] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:32:57.844537 29176 raft_consensus.cc:686] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [term 1 LEADER]: Becoming Leader. State: Replica: 22cfe85e9009404fa0c417b59e64ea22, State: Running, Role: LEADER
I20260808 23:32:57.845072 29176 consensus_queue.cc:237] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.849298 28638 catalog_manager.cc:5495] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22cfe85e9009404fa0c417b59e64ea22 (127.26.207.195). New cstate: current_term: 1 leader_uuid: "22cfe85e9009404fa0c417b59e64ea22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } health_report { overall_health: HEALTHY } } }
Aug 08 23:32:57 dist-test-slave-1x4g krb5kdc[28594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231975, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:32:57.920032 29212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.891782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36904 (local address 127.26.207.254:37841)
0808 23:32:57.894158 (+ 2376us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:57.894162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:57.894197 (+ 35us) server_negotiation.cc:407] Connection header received
0808 23:32:57.894247 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:57.894251 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:57.894311 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:57.894415 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:57.896976 (+ 2561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.897822 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.900607 (+ 2785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.901322 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.901450 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.911842 (+ 10392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:57.911849 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:57.911853 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:57.911896 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:57.916009 (+ 4113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:57.917282 (+ 1273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:57.917286 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:57.917289 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:57.917460 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:57.917905 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:57.917910 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:57.917914 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:57.918289 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:57.918488 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:57.919128 (+ 640us) server_negotiation.cc:299] Negotiation successful
0808 23:32:57.919515 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":112,"server-negotiator.queue_time_us":2203,"thread_start_us":1906,"threads_started":1}
I20260808 23:32:57.920075 29211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:57.891847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:37841 (local address 127.0.0.1:36904)
0808 23:32:57.893127 (+ 1280us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:57.893164 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:57.893383 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:57.894558 (+ 1175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:57.894572 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:57.896070 (+ 1498us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:32:57.896701 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.896743 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.897977 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.897983 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.900379 (+ 2396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:57.900407 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:57.901551 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:57.901559 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:57.901819 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:57.907663 (+ 5844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:32:57.907702 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:32:57.911560 (+ 3858us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:32:57.916228 (+ 4668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:57.916251 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:57.916260 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:57.917122 (+ 862us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:57.917593 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:32:57.917598 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:32:57.917602 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:32:57.917794 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:32:57.918444 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:32:57.918454 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:32:57.918730 (+ 276us) client_negotiation.cc:769] Sending connection context
0808 23:32:57.918963 (+ 233us) client_negotiation.cc:240] Negotiation successful
0808 23:32:57.919357 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1047,"spinlock_wait_cycles":896,"thread_start_us":824,"threads_started":1}
I20260808 23:32:57.927067 28638 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:36904:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 23:32:57.928511 28638 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:32:57.937788 28779 tablet_service.cc:1467] Processing CreateTablet for tablet 873de0099faf42b3a7d3268fac015082 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=af9995565b0e4a8793733a79c338f041]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 23:32:57.938117 28923 tablet_service.cc:1467] Processing CreateTablet for tablet 873de0099faf42b3a7d3268fac015082 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=af9995565b0e4a8793733a79c338f041]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 23:32:57.938517 28779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 873de0099faf42b3a7d3268fac015082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:32:57.938719 28923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 873de0099faf42b3a7d3268fac015082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:32:57.941512 29072 tablet_service.cc:1467] Processing CreateTablet for tablet 873de0099faf42b3a7d3268fac015082 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=af9995565b0e4a8793733a79c338f041]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 23:32:57.942374 29072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 873de0099faf42b3a7d3268fac015082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:32:57.948064 29170 tablet_bootstrap.cc:492] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe: Bootstrap starting.
I20260808 23:32:57.948935 29169 tablet_bootstrap.cc:492] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7: Bootstrap starting.
I20260808 23:32:57.951571 29170 tablet_bootstrap.cc:654] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe: Neither blocks nor log segments found. Creating new log.
I20260808 23:32:57.952358 29169 tablet_bootstrap.cc:654] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7: Neither blocks nor log segments found. Creating new log.
I20260808 23:32:57.956727 29168 tablet_bootstrap.cc:492] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22: Bootstrap starting.
I20260808 23:32:57.960711 29168 tablet_bootstrap.cc:654] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22: Neither blocks nor log segments found. Creating new log.
I20260808 23:32:57.963255 29170 tablet_bootstrap.cc:492] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe: No bootstrap required, opened a new log
I20260808 23:32:57.963544 29170 ts_tablet_manager.cc:1397] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe: Time spent bootstrapping tablet: real 0.015s user 0.012s sys 0.000s
I20260808 23:32:57.964496 29170 raft_consensus.cc:348] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.964906 29170 raft_consensus.cc:374] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:32:57.965013 29170 raft_consensus.cc:729] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fe5fcb21a1549f1bb985eaed377bdbe, State: Initialized, Role: FOLLOWER
I20260808 23:32:57.965292 29170 consensus_queue.cc:260] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.965957 29175 tablet_replica.cc:439] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } }
I20260808 23:32:57.966455 29175 tablet_replica.cc:442] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:32:57.967097 29168 tablet_bootstrap.cc:492] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22: No bootstrap required, opened a new log
I20260808 23:32:57.967319 29168 ts_tablet_manager.cc:1397] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.007s
I20260808 23:32:57.967770 29170 ts_tablet_manager.cc:1428] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260808 23:32:57.968355 29168 raft_consensus.cc:348] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.968637 29168 raft_consensus.cc:374] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:32:57.968729 29168 raft_consensus.cc:729] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22cfe85e9009404fa0c417b59e64ea22, State: Initialized, Role: FOLLOWER
I20260808 23:32:57.969633 29168 consensus_queue.cc:260] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.969998 29169 tablet_bootstrap.cc:492] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7: No bootstrap required, opened a new log
I20260808 23:32:57.970239 29169 ts_tablet_manager.cc:1397] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7: Time spent bootstrapping tablet: real 0.021s user 0.012s sys 0.004s
I20260808 23:32:57.970443 29168 ts_tablet_manager.cc:1428] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 23:32:57.971227 29169 raft_consensus.cc:348] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.971593 29169 raft_consensus.cc:374] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:32:57.971714 29169 raft_consensus.cc:729] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7def850e87d3418cb1bd2e26d816c3c7, State: Initialized, Role: FOLLOWER
I20260808 23:32:57.970296 29176 tablet_replica.cc:439] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } }
I20260808 23:32:57.972155 29176 tablet_replica.cc:442] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:32:57.972088 29169 consensus_queue.cc:260] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.972925 29169 ts_tablet_manager.cc:1428] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 23:32:57.972643 29174 tablet_replica.cc:439] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } }
I20260808 23:32:57.973572 29174 tablet_replica.cc:442] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:32:57.992498 29175 raft_consensus.cc:482] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:32:57.992743 29175 raft_consensus.cc:504] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.993562 29175 leader_election.cc:288] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7def850e87d3418cb1bd2e26d816c3c7 (127.26.207.194:33339), 22cfe85e9009404fa0c417b59e64ea22 (127.26.207.195:39505)
I20260808 23:32:57.994186 28945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "873de0099faf42b3a7d3268fac015082" candidate_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7def850e87d3418cb1bd2e26d816c3c7" is_pre_election: true
I20260808 23:32:57.994267 29092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "873de0099faf42b3a7d3268fac015082" candidate_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22cfe85e9009404fa0c417b59e64ea22" is_pre_election: true
I20260808 23:32:57.994549 28945 raft_consensus.cc:2454] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fe5fcb21a1549f1bb985eaed377bdbe in term 0.
I20260808 23:32:57.994562 29092 raft_consensus.cc:2454] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fe5fcb21a1549f1bb985eaed377bdbe in term 0.
I20260808 23:32:57.995141 28731 leader_election.cc:302] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fe5fcb21a1549f1bb985eaed377bdbe, 7def850e87d3418cb1bd2e26d816c3c7; no voters:
I20260808 23:32:57.995515 29175 raft_consensus.cc:2781] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:32:57.995654 29175 raft_consensus.cc:482] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:32:57.995774 29175 raft_consensus.cc:3037] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:32:57.998311 29175 raft_consensus.cc:504] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:57.999126 29175 leader_election.cc:288] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [CANDIDATE]: Term 1 election: Requested vote from peers 7def850e87d3418cb1bd2e26d816c3c7 (127.26.207.194:33339), 22cfe85e9009404fa0c417b59e64ea22 (127.26.207.195:39505)
I20260808 23:32:57.999614 28945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "873de0099faf42b3a7d3268fac015082" candidate_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7def850e87d3418cb1bd2e26d816c3c7"
I20260808 23:32:57.999780 29092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "873de0099faf42b3a7d3268fac015082" candidate_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22cfe85e9009404fa0c417b59e64ea22"
I20260808 23:32:57.999903 28945 raft_consensus.cc:3037] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:32:58.000049 29092 raft_consensus.cc:3037] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:32:58.003506 29092 raft_consensus.cc:2454] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fe5fcb21a1549f1bb985eaed377bdbe in term 1.
I20260808 23:32:58.003499 28945 raft_consensus.cc:2454] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fe5fcb21a1549f1bb985eaed377bdbe in term 1.
I20260808 23:32:58.004196 28730 leader_election.cc:302] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 22cfe85e9009404fa0c417b59e64ea22, 4fe5fcb21a1549f1bb985eaed377bdbe, 7def850e87d3418cb1bd2e26d816c3c7; no voters:
I20260808 23:32:58.004616 29175 raft_consensus.cc:2781] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:32:58.004892 29175 raft_consensus.cc:686] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [term 1 LEADER]: Becoming Leader. State: Replica: 4fe5fcb21a1549f1bb985eaed377bdbe, State: Running, Role: LEADER
I20260808 23:32:58.005298 29175 consensus_queue.cc:237] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } }
I20260808 23:32:58.007452 29182 tablet_replica.cc:439] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe: TxnStatusTablet state changed. Reason: New leader 4fe5fcb21a1549f1bb985eaed377bdbe. Latest consensus state: current_term: 1 leader_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } }
I20260808 23:32:58.007853 29182 tablet_replica.cc:442] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe: This TxnStatusTablet replica's current role is: LEADER
I20260808 23:32:58.008946 29217 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 23:32:58.009472 29217 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 23:32:58.009728 28639 catalog_manager.cc:5495] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4fe5fcb21a1549f1bb985eaed377bdbe (127.26.207.193). New cstate: current_term: 1 leader_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } health_report { overall_health: UNKNOWN } } }
I20260808 23:32:58.030840 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:58.024403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36136 (local address 127.26.207.193:38051)
0808 23:32:58.024975 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:58.024980 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:58.025000 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:32:58.025096 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:58.025100 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:58.025164 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:58.025253 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:32:58.025726 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.026481 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.028637 (+ 2156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.029345 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.029495 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:58.030077 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:32:58.030228 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:32:58.030298 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:58.030475 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 23:32:58.030552 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431}
I20260808 23:32:58.030954 29211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:58.024408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:38051 (local address 127.0.0.1:36136)
0808 23:32:58.024688 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:58.024710 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:58.024913 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:58.025306 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:58.025312 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:58.025326 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 23:32:58.025561 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:58.025577 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.026625 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.026632 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:58.028435 (+ 1803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:58.028454 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.029562 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.029568 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:58.029778 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:58.029866 (+ 88us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 23:32:58.030327 (+ 461us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 23:32:58.030351 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 23:32:58.030439 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 23:32:58.030609 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 23:32:58.035432 29092 raft_consensus.cc:1261] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22 [term 1 FOLLOWER]: Refusing update from remote peer 4fe5fcb21a1549f1bb985eaed377bdbe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:32:58.035526 28945 raft_consensus.cc:1261] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7 [term 1 FOLLOWER]: Refusing update from remote peer 4fe5fcb21a1549f1bb985eaed377bdbe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:32:58.036160 29175 consensus_queue.cc:1035] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:32:58.036753 29182 consensus_queue.cc:1035] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe [LEADER]: Connected to new peer: Peer: permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:32:58.039768 29174 tablet_replica.cc:439] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7: TxnStatusTablet state changed. Reason: New leader 4fe5fcb21a1549f1bb985eaed377bdbe. Latest consensus state: current_term: 1 leader_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } }
I20260808 23:32:58.040145 29174 tablet_replica.cc:442] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:32:58.041941 29175 tablet_replica.cc:439] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } }
I20260808 23:32:58.042303 29175 tablet_replica.cc:442] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe: This TxnStatusTablet replica's current role is: LEADER
I20260808 23:32:58.042619 29188 mvcc.cc:205] Tried to move back new op lower bound from 7316406182025936896 to 7316406181912588288. Current Snapshot: MvccSnapshot[applied={T|T < 7316406182025936896}]
I20260808 23:32:58.044113 29174 tablet_replica.cc:439] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } }
I20260808 23:32:58.044379 29174 tablet_replica.cc:442] T 873de0099faf42b3a7d3268fac015082 P 7def850e87d3418cb1bd2e26d816c3c7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:32:58.045462 29176 tablet_replica.cc:439] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22: TxnStatusTablet state changed. Reason: New leader 4fe5fcb21a1549f1bb985eaed377bdbe. Latest consensus state: current_term: 1 leader_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } }
I20260808 23:32:58.045799 29176 tablet_replica.cc:442] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:32:58.047861 29190 tablet_replica.cc:439] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } }
I20260808 23:32:58.048302 29190 tablet_replica.cc:442] T 873de0099faf42b3a7d3268fac015082 P 4fe5fcb21a1549f1bb985eaed377bdbe: This TxnStatusTablet replica's current role is: LEADER
I20260808 23:32:58.049404 29176 tablet_replica.cc:439] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 } } peers { permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 } } peers { permanent_uuid: "22cfe85e9009404fa0c417b59e64ea22" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39505 } } }
I20260808 23:32:58.049726 29176 tablet_replica.cc:442] T 873de0099faf42b3a7d3268fac015082 P 22cfe85e9009404fa0c417b59e64ea22: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:32:58.059620 29160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:58.052598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51728 (local address 127.26.207.195:39505)
0808 23:32:58.052771 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:58.052778 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:58.052958 (+ 180us) server_negotiation.cc:407] Connection header received
0808 23:32:58.053229 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:58.053235 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:58.053356 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:58.053539 (+ 183us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:32:58.054035 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.055125 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.057159 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.057753 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.057917 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:58.058396 (+ 479us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:32:58.058984 (+ 588us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:32:58.059148 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:58.059233 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 23:32:58.059326 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 23:32:58.095813 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:58.084681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:58955 (local address 127.26.207.193:38051)
0808 23:32:58.084951 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:58.084957 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:58.085293 (+ 336us) server_negotiation.cc:407] Connection header received
0808 23:32:58.085611 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:58.085619 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:58.085716 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:58.085833 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:32:58.088946 (+ 3113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.090341 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.092982 (+ 2641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.093819 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.093951 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:58.094761 (+ 810us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:32:58.094931 (+ 170us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:32:58.095001 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:58.095275 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 23:32:58.095388 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 23:32:58.096873 29224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:58.084212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:38051 (local address 127.26.207.195:58955)
0808 23:32:58.085143 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:58.085170 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:58.085381 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:58.085893 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:58.085901 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:58.085919 (+ 18us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 23:32:58.086492 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:58.086511 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.090615 (+ 4104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.090623 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:58.092680 (+ 2057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:58.092707 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.094199 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.094206 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:58.094395 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:58.094496 (+ 101us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 23:32:58.095117 (+ 621us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 23:32:58.095130 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 23:32:58.096069 (+ 939us) client_negotiation.cc:240] Negotiation successful
0808 23:32:58.096282 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"thread_start_us":751,"threads_started":1}
I20260808 23:32:58.111660 28945 raft_consensus.cc:1261] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7 [term 1 FOLLOWER]: Refusing update from remote peer 22cfe85e9009404fa0c417b59e64ea22: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:32:58.112046 28802 raft_consensus.cc:1261] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 1 FOLLOWER]: Refusing update from remote peer 22cfe85e9009404fa0c417b59e64ea22: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:32:58.112612 29204 consensus_queue.cc:1035] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7def850e87d3418cb1bd2e26d816c3c7" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:32:58.113464 29176 consensus_queue.cc:1035] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fe5fcb21a1549f1bb985eaed377bdbe" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:32:58.123129 29186 mvcc.cc:205] Tried to move back new op lower bound from 7316406182337613824 to 7316406181257859072. Current Snapshot: MvccSnapshot[applied={T|T < 7316406182337613824}]
I20260808 23:32:58.177807 29160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:58.157267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:44947 (local address 127.26.207.195:39505)
0808 23:32:58.157565 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:58.157572 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:58.157936 (+ 364us) server_negotiation.cc:407] Connection header received
0808 23:32:58.158202 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:58.158207 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:58.158303 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:58.158441 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:32:58.160361 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.161714 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.169407 (+ 7693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.170431 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.170570 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:58.176631 (+ 6061us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:32:58.176866 (+ 235us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:32:58.176949 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:58.177255 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 23:32:58.177368 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260808 23:32:58.179239 29230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:58.156747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:39505 (local address 127.26.207.193:44947)
0808 23:32:58.157816 (+ 1069us) negotiation.cc:107] Waiting for socket to connect
0808 23:32:58.157843 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 23:32:58.158047 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:32:58.158463 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:32:58.158468 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:32:58.158482 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 23:32:58.160072 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:58.160093 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.161940 (+ 1847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.161946 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:58.164311 (+ 2365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:32:58.164334 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.175267 (+ 10933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.175282 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:32:58.176003 (+ 721us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:58.176126 (+ 123us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 23:32:58.177067 (+ 941us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 23:32:58.177088 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 23:32:58.178355 (+ 1267us) client_negotiation.cc:240] Negotiation successful
0808 23:32:58.178581 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":741,"thread_start_us":812,"threads_started":1}
I20260808 23:32:58.257296 28637 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:32:58.257615 28637 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:32:58.261945 28637 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7f272a93f25b40d98188e0455b1f4e41: Sending DeleteTablet for 3 replicas of tablet 36f1cff8995e4353a8ccde4d8f0a469e
I20260808 23:32:58.263034 28779 tablet_service.cc:1514] Processing DeleteTablet for tablet 36f1cff8995e4353a8ccde4d8f0a469e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:32:58 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:36110
I20260808 23:32:58.263468 28923 tablet_service.cc:1514] Processing DeleteTablet for tablet 36f1cff8995e4353a8ccde4d8f0a469e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:32:58 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:58228
I20260808 23:32:58.263815 29197 tablet_replica.cc:330] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe: stopping tablet replica
I20260808 23:32:58.264070 29197 raft_consensus.cc:2229] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:32:58.264308 29197 raft_consensus.cc:2258] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:32:58.264969 29195 tablet_replica.cc:330] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7: stopping tablet replica
I20260808 23:32:58.265205 29195 raft_consensus.cc:2229] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:32:58.265455 29195 raft_consensus.cc:2258] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:32:58.266685 29072 tablet_service.cc:1514] Processing DeleteTablet for tablet 36f1cff8995e4353a8ccde4d8f0a469e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:32:58 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:51714
I20260808 23:32:58.267030 29195 ts_tablet_manager.cc:1905] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:32:58.272358 29197 ts_tablet_manager.cc:1905] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:32:58.279232 29195 ts_tablet_manager.cc:1918] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 23:32:58.279490 29195 log.cc:1196] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/36f1cff8995e4353a8ccde4d8f0a469e
I20260808 23:32:58.280134 29195 ts_tablet_manager.cc:1939] T 36f1cff8995e4353a8ccde4d8f0a469e P 7def850e87d3418cb1bd2e26d816c3c7: Deleting consensus metadata
I20260808 23:32:58.290987 29197 ts_tablet_manager.cc:1918] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 23:32:58.293025 29197 log.cc:1196] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/36f1cff8995e4353a8ccde4d8f0a469e
I20260808 23:32:58.293780 28625 catalog_manager.cc:4841] TS 7def850e87d3418cb1bd2e26d816c3c7 (127.26.207.194:33339): tablet 36f1cff8995e4353a8ccde4d8f0a469e (table test-table [id=46b33d5796c4421ead5a667152db5625]) successfully deleted
I20260808 23:32:58.294526 29233 tablet_replica.cc:330] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22: stopping tablet replica
I20260808 23:32:58.293895 29197 ts_tablet_manager.cc:1939] T 36f1cff8995e4353a8ccde4d8f0a469e P 4fe5fcb21a1549f1bb985eaed377bdbe: Deleting consensus metadata
I20260808 23:32:58.294775 29233 raft_consensus.cc:2229] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:32:58.295554 29233 raft_consensus.cc:2258] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:32:58.297132 29233 ts_tablet_manager.cc:1905] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:32:58.297937 28626 catalog_manager.cc:4841] TS 4fe5fcb21a1549f1bb985eaed377bdbe (127.26.207.193:38051): tablet 36f1cff8995e4353a8ccde4d8f0a469e (table test-table [id=46b33d5796c4421ead5a667152db5625]) successfully deleted
Aug 08 23:32:58 dist-test-slave-1x4g krb5kdc[28594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231977, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:32:58.314311 29233 ts_tablet_manager.cc:1918] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 23:32:58.314507 29233 log.cc:1196] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/36f1cff8995e4353a8ccde4d8f0a469e
I20260808 23:32:58.315061 29233 ts_tablet_manager.cc:1939] T 36f1cff8995e4353a8ccde4d8f0a469e P 22cfe85e9009404fa0c417b59e64ea22: Deleting consensus metadata
I20260808 23:32:58.316514 28624 catalog_manager.cc:4841] TS 22cfe85e9009404fa0c417b59e64ea22 (127.26.207.195:39505): tablet 36f1cff8995e4353a8ccde4d8f0a469e (table test-table [id=46b33d5796c4421ead5a667152db5625]) successfully deleted
I20260808 23:32:58.317839 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:58.288939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36146 (local address 127.26.207.193:38051)
0808 23:32:58.289173 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:58.289180 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:58.291533 (+ 2353us) server_negotiation.cc:407] Connection header received
0808 23:32:58.292851 (+ 1318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:58.292857 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:58.292962 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:58.293058 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:58.295853 (+ 2795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.297137 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.299773 (+ 2636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.300561 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.300674 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:58.307009 (+ 6335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:58.307033 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:58.307054 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:58.307104 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:58.312219 (+ 5115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:58.313469 (+ 1250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:58.313480 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:58.313484 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:58.313702 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:58.314274 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:58.314282 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:58.314285 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:58.314989 (+ 704us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:58.315375 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:58.316114 (+ 739us) server_negotiation.cc:299] Negotiation successful
0808 23:32:58.317379 (+ 1265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
W20260808 23:32:58.319756 28846 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36146
I20260808 23:32:58.361953 29212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:58.338941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36908 (local address 127.26.207.254:37841)
0808 23:32:58.339181 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:58.339189 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:58.341435 (+ 2246us) server_negotiation.cc:407] Connection header received
0808 23:32:58.341673 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:58.341679 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:58.341775 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:58.341900 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:58.344211 (+ 2311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.345398 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.347779 (+ 2381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.348547 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.348670 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:58.353004 (+ 4334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:58.353013 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:58.353018 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:58.353076 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:58.357835 (+ 4759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:58.359030 (+ 1195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:58.359037 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:58.359042 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:58.359225 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:58.359714 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:58.359719 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:58.359723 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:58.360152 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:58.360416 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:58.360948 (+ 532us) server_negotiation.cc:299] Negotiation successful
0808 23:32:58.361232 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
W20260808 23:32:58.362636 28637 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36908
I20260808 23:32:58.365396 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 28713
I20260808 23:32:58.390424 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:58.368820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36162 (local address 127.26.207.193:38051)
0808 23:32:58.369054 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:58.369065 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:58.369949 (+ 884us) server_negotiation.cc:407] Connection header received
0808 23:32:58.370316 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:58.370323 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:58.370422 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:58.370502 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:58.372702 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.374209 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.376249 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.377054 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.377208 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:58.381002 (+ 3794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:58.381010 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:58.381015 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:58.381097 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:58.386029 (+ 4932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:58.387481 (+ 1452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:58.387488 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:58.387492 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:58.387768 (+ 276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:58.388307 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:58.388313 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:58.388317 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:58.388770 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:58.389147 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:58.389611 (+ 464us) server_negotiation.cc:299] Negotiation successful
0808 23:32:58.389929 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260808 23:32:58.391327 28846 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36162
W20260808 23:32:58.392094 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 28713: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:32:58.392344 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 28713
I20260808 23:32:58.421152 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 28858
Aug 08 23:32:58 dist-test-slave-1x4g krb5kdc[28594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231977, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:32:58.442641 29239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:58.422070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58236 (local address 127.26.207.194:33339)
0808 23:32:58.423043 (+ 973us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:58.423051 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:58.423071 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:32:58.423144 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:58.423149 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:58.423238 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:58.423360 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:58.425125 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.426294 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.428264 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.428970 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.429100 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:58.434970 (+ 5870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:58.434994 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:58.435017 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:58.435083 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:58.439271 (+ 4188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:58.440265 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:58.440276 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:58.440280 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:58.440448 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:58.440894 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:58.440900 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:58.440904 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:58.441315 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:58.441666 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:58.442001 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 23:32:58.442263 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":848,"thread_start_us":684,"threads_started":1}
W20260808 23:32:58.443310 28992 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58236
W20260808 23:32:58.443997 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 28858: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:32:58.444186 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 28858
I20260808 23:32:58.467023 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 29001
Aug 08 23:32:58 dist-test-slave-1x4g krb5kdc[28594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231977, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:32:58.486276 29160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:32:58.467875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51744 (local address 127.26.207.195:39505)
0808 23:32:58.468096 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 23:32:58.468102 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:32:58.468126 (+ 24us) server_negotiation.cc:407] Connection header received
0808 23:32:58.468282 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:32:58.468289 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:32:58.468373 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:32:58.468494 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:32:58.469949 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.471173 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.472604 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:32:58.473522 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:32:58.473669 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:32:58.478448 (+ 4779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:32:58.478470 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:32:58.478493 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:32:58.478559 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:32:58.482973 (+ 4414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:58.483871 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:58.483881 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:58.483885 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:58.484089 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:32:58.484491 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:32:58.484496 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:32:58.484499 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:32:58.485031 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:32:58.485383 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0808 23:32:58.485607 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 23:32:58.485870 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260808 23:32:58.487123 29141 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51744
W20260808 23:32:58.487821 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 29001: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:32:58.488003 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 29001
I20260808 23:32:58.509023 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 28607
I20260808 23:32:58.510216 28681 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:32:58.631212 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 28607
2026-08-08T23:32:58Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5063 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:32:58 dist-test-slave-1x4g krb5kdc[29243](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:32:58 dist-test-slave-1x4g krb5kdc[29243](info): set up 2 sockets
Aug 08 23:32:58 dist-test-slave-1x4g krb5kdc[29243](info): commencing operation
krb5kdc: starting...
W20260808 23:32:59.789680 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.000s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:32:59 dist-test-slave-1x4g krb5kdc[29243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231979, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:32:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:32:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:33:00.041913 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:40521
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:40521
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:00.410127 29256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:00.410475 29256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:00.410637 29256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:00.418583 29256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:33:00.418721 29256 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 23:33:00.418824 29256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:00.418951 29256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:00.419041 29256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:33:00.419152 29256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:33:00.430027 29256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:40521
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:40521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:00.431495 29256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:00.433032 29256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:00.445972 29262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:00.446137 29263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:00.446316 29265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:00.447175 29256 server_base.cc:1034] running on GCE node
I20260808 23:33:00.448084 29256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:00.449802 29256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:00.451165 29256 hybrid_clock.cc:648] HybridClock initialized: now 1786231980451040 us; error 84 us; skew 500 ppm
I20260808 23:33:00.451618 29256 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:00 dist-test-slave-1x4g krb5kdc[29243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231980, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:00.455565 29256 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:33:00.457516 29256 webserver.cc:460] Webserver started at http://127.26.207.254:41821/ using document root <none> and password file <none>
I20260808 23:33:00.458356 29256 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:00.458478 29256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:00.458796 29256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:00.462428 29256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "cbb868c0d095491690ef18b5c1b1ae6d"
format_stamp: "Formatted at 2026-08-08 23:33:00 on dist-test-slave-1x4g"
server_key: "4c613f66a6f687f6e631e8090b61e24b"
server_key_iv: "a1cd2e71ebef901fca0a0678e05e0d0a"
server_key_version: "encryptionkey@0"
I20260808 23:33:00.463366 29256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "cbb868c0d095491690ef18b5c1b1ae6d"
format_stamp: "Formatted at 2026-08-08 23:33:00 on dist-test-slave-1x4g"
server_key: "4c613f66a6f687f6e631e8090b61e24b"
server_key_iv: "a1cd2e71ebef901fca0a0678e05e0d0a"
server_key_version: "encryptionkey@0"
I20260808 23:33:00.469822 29256 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260808 23:33:00.473984 29273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:00.475862 29256 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 23:33:00.476131 29256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "cbb868c0d095491690ef18b5c1b1ae6d"
format_stamp: "Formatted at 2026-08-08 23:33:00 on dist-test-slave-1x4g"
server_key: "4c613f66a6f687f6e631e8090b61e24b"
server_key_iv: "a1cd2e71ebef901fca0a0678e05e0d0a"
server_key_version: "encryptionkey@0"
I20260808 23:33:00.476395 29256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:00.500561 29256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:00.505694 29256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:00.506031 29256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:00.530057 29256 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:40521
I20260808 23:33:00.530076 29338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:40521 every 8 connection(s)
I20260808 23:33:00.531595 29256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:33:00.535735 29339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:00.538483 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 29256
I20260808 23:33:00.538727 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:33:00.539419 27455 external_mini_cluster.cc:1428] Setting key 664b154c8cdcaddccc1bc223214bc861
I20260808 23:33:00.549412 29339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d: Bootstrap starting.
I20260808 23:33:00.553799 29339 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:00.555342 29339 log.cc:824] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d: Log is configured to *not* fsync() on all Append() calls
Aug 08 23:33:00 dist-test-slave-1x4g krb5kdc[29243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231979, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:00.559124 29339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d: No bootstrap required, opened a new log
I20260808 23:33:00.566671 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:00.541802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45734 (local address 127.26.207.254:40521)
0808 23:33:00.542740 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:00.542753 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:00.542800 (+ 47us) server_negotiation.cc:407] Connection header received
0808 23:33:00.544620 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:00.544649 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:00.545200 (+ 551us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:00.545582 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:00.547581 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:00.549145 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:00.551069 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:00.551875 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:00.552149 (+ 274us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:00.557630 (+ 5481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:00.557639 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:00.557656 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:00.557698 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:00.561607 (+ 3909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:00.562680 (+ 1073us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:00.562689 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:00.562697 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:00.562921 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:00.563402 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:00.563406 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:00.563409 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:00.564063 (+ 654us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:00.564303 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:00.564972 (+ 669us) server_negotiation.cc:299] Negotiation successful
0808 23:33:00.565483 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":448,"threads_started":1}
I20260808 23:33:00.568583 29339 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbb868c0d095491690ef18b5c1b1ae6d" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40521 } }
I20260808 23:33:00.569149 29339 raft_consensus.cc:374] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:00.569274 29339 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbb868c0d095491690ef18b5c1b1ae6d, State: Initialized, Role: FOLLOWER
I20260808 23:33:00.569891 29339 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbb868c0d095491690ef18b5c1b1ae6d" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40521 } }
I20260808 23:33:00.570176 29339 raft_consensus.cc:388] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:33:00.570329 29339 raft_consensus.cc:482] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:33:00.570521 29339 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:00.572979 29339 raft_consensus.cc:504] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbb868c0d095491690ef18b5c1b1ae6d" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40521 } }
I20260808 23:33:00.573566 29339 leader_election.cc:302] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbb868c0d095491690ef18b5c1b1ae6d; no voters:
I20260808 23:33:00.574240 29339 leader_election.cc:288] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:33:00.574390 29344 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:00.575150 29344 raft_consensus.cc:686] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [term 1 LEADER]: Becoming Leader. State: Replica: cbb868c0d095491690ef18b5c1b1ae6d, State: Running, Role: LEADER
I20260808 23:33:00.575881 29344 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbb868c0d095491690ef18b5c1b1ae6d" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40521 } }
I20260808 23:33:00.576638 29339 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:33:00.579365 29346 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbb868c0d095491690ef18b5c1b1ae6d. Latest consensus state: current_term: 1 leader_uuid: "cbb868c0d095491690ef18b5c1b1ae6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbb868c0d095491690ef18b5c1b1ae6d" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40521 } } }
I20260808 23:33:00.579631 29345 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbb868c0d095491690ef18b5c1b1ae6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbb868c0d095491690ef18b5c1b1ae6d" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40521 } } }
I20260808 23:33:00.579931 29346 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:00.579974 29345 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:00.589426 29351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:33:00.594854 29351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:33:00.605747 29351 catalog_manager.cc:1347] Generated new cluster ID: 212399cfdbd9490d995656d6ed268ade
I20260808 23:33:00.605886 29351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:33:00.619026 29351 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:33:00.620585 29351 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:33:00.634529 29351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d: Generated new TSK 0
I20260808 23:33:00.635594 29351 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:33:00.719435 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:40521
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:01.111456 29365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:01.111837 29365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:01.111958 29365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:01.119803 29365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:01.120021 29365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:01.120177 29365 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 23:33:01.120268 29365 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 23:33:01.120406 29365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:33:01.131101 29365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.207.254:40521
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:01.132596 29365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:01.134178 29365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:01.148653 29370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:01.148579 29371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:01.148627 29373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:01.149941 29365 server_base.cc:1034] running on GCE node
I20260808 23:33:01.150676 29365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:01.151772 29365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:01.153018 29365 hybrid_clock.cc:648] HybridClock initialized: now 1786231981152962 us; error 53 us; skew 500 ppm
I20260808 23:33:01.153365 29365 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:01 dist-test-slave-1x4g krb5kdc[29243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231981, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:01.157037 29365 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:33:01.158732 29365 webserver.cc:460] Webserver started at http://127.26.207.193:36631/ using document root <none> and password file <none>
I20260808 23:33:01.159514 29365 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:01.159677 29365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:01.160038 29365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:01.163379 29365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "39850fc924294e83a6161a5f80efe85e"
format_stamp: "Formatted at 2026-08-08 23:33:01 on dist-test-slave-1x4g"
server_key: "0e402e335dd85b9b4160d2d47b15ee9b"
server_key_iv: "97e0e7e9c4573496dba631169dd45d8f"
server_key_version: "encryptionkey@0"
I20260808 23:33:01.164253 29365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "39850fc924294e83a6161a5f80efe85e"
format_stamp: "Formatted at 2026-08-08 23:33:01 on dist-test-slave-1x4g"
server_key: "0e402e335dd85b9b4160d2d47b15ee9b"
server_key_iv: "97e0e7e9c4573496dba631169dd45d8f"
server_key_version: "encryptionkey@0"
I20260808 23:33:01.170419 29365 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260808 23:33:01.175006 29380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:01.176625 29365 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 23:33:01.176895 29365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "39850fc924294e83a6161a5f80efe85e"
format_stamp: "Formatted at 2026-08-08 23:33:01 on dist-test-slave-1x4g"
server_key: "0e402e335dd85b9b4160d2d47b15ee9b"
server_key_iv: "97e0e7e9c4573496dba631169dd45d8f"
server_key_version: "encryptionkey@0"
I20260808 23:33:01.177204 29365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:01.195158 29365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:01.200335 29365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:01.200618 29365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:01.203966 29365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:01.204216 29365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:01.204391 29365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:01.204497 29365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 23:33:01 dist-test-slave-1x4g krb5kdc[29243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231981, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:01.233249 29392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:01.205457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40521 (local address 127.26.207.193:42159)
0808 23:33:01.206449 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:01.206501 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:01.208640 (+ 2139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:01.209703 (+ 1063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:01.209723 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:01.210935 (+ 1212us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:01.212145 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:01.212188 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:01.213784 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:01.213795 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:01.217090 (+ 3295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:01.217120 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:01.218110 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:01.218122 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:01.218551 (+ 429us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:01.219586 (+ 1035us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:01.219632 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:01.223349 (+ 3717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:01.227557 (+ 4208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:01.227568 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:01.227586 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:01.228125 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:01.228588 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:01.228600 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:01.228603 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:01.228990 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:01.229733 (+ 743us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:01.229742 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:01.230197 (+ 455us) client_negotiation.cc:769] Sending connection context
0808 23:33:01.230635 (+ 438us) client_negotiation.cc:240] Negotiation successful
0808 23:33:01.231286 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"thread_start_us":457,"threads_started":1}
I20260808 23:33:01.233743 29390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:01.204644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:42159 (local address 127.26.207.254:40521)
0808 23:33:01.205537 (+ 893us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:01.205542 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:01.206657 (+ 1115us) server_negotiation.cc:407] Connection header received
0808 23:33:01.209050 (+ 2393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:01.209056 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:01.209162 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:01.209302 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:01.212462 (+ 3160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:01.213533 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:01.217347 (+ 3814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:01.217785 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:01.217911 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:01.223676 (+ 5765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:01.223682 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:01.223686 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:01.223728 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:01.227334 (+ 3606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:01.228295 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:01.228301 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:01.228306 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:01.228454 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:01.229132 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:01.229138 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:01.229142 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:01.229581 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:01.229750 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:01.233067 (+ 3317us) server_negotiation.cc:299] Negotiation successful
0808 23:33:01.233376 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":780,"thread_start_us":689,"threads_started":1}
I20260808 23:33:01.263770 29390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:01.244845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:43369 (local address 127.26.207.254:40521)
0808 23:33:01.245026 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:01.245031 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:01.246018 (+ 987us) server_negotiation.cc:407] Connection header received
0808 23:33:01.246274 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:01.246282 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:01.246397 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:01.246529 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:01.247611 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:01.248954 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:01.251746 (+ 2792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:01.252595 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:01.252805 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:01.255503 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:01.255514 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:01.255522 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:01.255576 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:01.259883 (+ 4307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:01.261080 (+ 1197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:01.261088 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:01.261094 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:01.261287 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:01.261857 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:01.261862 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:01.261865 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:01.262251 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:01.262446 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:01.262946 (+ 500us) server_negotiation.cc:299] Negotiation successful
0808 23:33:01.263306 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 23:33:01.263885 29458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:01.244798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40521 (local address 127.26.207.193:43369)
0808 23:33:01.245850 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:01.245878 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:01.246113 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:01.246607 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:01.246613 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:01.247108 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:01.247429 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:01.247440 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:01.249287 (+ 1847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:01.249296 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:01.251501 (+ 2205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:01.251527 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:01.252860 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:01.252874 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:01.253158 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:01.254127 (+ 969us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:01.254164 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:01.255203 (+ 1039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:01.260078 (+ 4875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:01.260087 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:01.260094 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:01.260912 (+ 818us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:01.261453 (+ 541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:01.261459 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:01.261465 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:01.261691 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:01.262386 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:01.262389 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:01.262588 (+ 199us) client_negotiation.cc:769] Sending connection context
0808 23:33:01.262771 (+ 183us) client_negotiation.cc:240] Negotiation successful
0808 23:33:01.263222 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":836,"thread_start_us":532,"threads_started":1}
I20260808 23:33:01.264655 29365 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:36913
I20260808 23:33:01.264743 29510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:36913 every 8 connection(s)
I20260808 23:33:01.266355 29365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:33:01.268875 29511 heartbeater.cc:347] Connected to a master server at 127.26.207.254:40521
I20260808 23:33:01.269292 29511 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:01.270045 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 29365
I20260808 23:33:01.270195 29511 heartbeater.cc:511] Master 127.26.207.254:40521 requested a full tablet report, sending...
I20260808 23:33:01.270280 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:33:01.271157 27455 external_mini_cluster.cc:1428] Setting key 246a041977f271b16b4af8fe513fc4b1
I20260808 23:33:01.272761 29290 ts_manager.cc:194] Registered new tserver with Master: 39850fc924294e83a6161a5f80efe85e (127.26.207.193:36913)
I20260808 23:33:01.274439 29290 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:42159
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:33:01.324496 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:40521
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:01.693709 29515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:01.694051 29515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:01.694233 29515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:01.702128 29515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:01.702278 29515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:01.702445 29515 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 23:33:01.702541 29515 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 23:33:01.702693 29515 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:33:01.713567 29515 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.207.254:40521
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:01.715121 29515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:01.716708 29515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:01.732426 29522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:01.732509 29521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:01.732481 29524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:01.733278 29515 server_base.cc:1034] running on GCE node
I20260808 23:33:01.734038 29515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:01.735178 29515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:01.736490 29515 hybrid_clock.cc:648] HybridClock initialized: now 1786231981736422 us; error 62 us; skew 500 ppm
I20260808 23:33:01.737053 29515 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:01 dist-test-slave-1x4g krb5kdc[29243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231981, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:01.740756 29515 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:33:01.742565 29515 webserver.cc:460] Webserver started at http://127.26.207.194:39911/ using document root <none> and password file <none>
I20260808 23:33:01.743423 29515 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:01.743599 29515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:01.743973 29515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:01.747411 29515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "a09d2990e8af4696984a7e5ae4415212"
format_stamp: "Formatted at 2026-08-08 23:33:01 on dist-test-slave-1x4g"
server_key: "a2a4ae5483bb5da8cbd2bced7aabbbf4"
server_key_iv: "091bdc89821d04b41dbb7ea31affe480"
server_key_version: "encryptionkey@0"
I20260808 23:33:01.748324 29515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "a09d2990e8af4696984a7e5ae4415212"
format_stamp: "Formatted at 2026-08-08 23:33:01 on dist-test-slave-1x4g"
server_key: "a2a4ae5483bb5da8cbd2bced7aabbbf4"
server_key_iv: "091bdc89821d04b41dbb7ea31affe480"
server_key_version: "encryptionkey@0"
I20260808 23:33:01.754520 29515 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 23:33:01.758792 29531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:01.760401 29515 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 23:33:01.760634 29515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "a09d2990e8af4696984a7e5ae4415212"
format_stamp: "Formatted at 2026-08-08 23:33:01 on dist-test-slave-1x4g"
server_key: "a2a4ae5483bb5da8cbd2bced7aabbbf4"
server_key_iv: "091bdc89821d04b41dbb7ea31affe480"
server_key_version: "encryptionkey@0"
I20260808 23:33:01.760928 29515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:01.778376 29515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:01.783393 29515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:01.783730 29515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:01.787005 29515 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:01.787149 29515 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:01.787298 29515 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:01.787391 29515 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 23:33:01 dist-test-slave-1x4g krb5kdc[29243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231981, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:01.814756 29539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:01.787480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:45743 (local address 127.26.207.254:40521)
0808 23:33:01.787942 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:01.787946 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:01.789494 (+ 1548us) server_negotiation.cc:407] Connection header received
0808 23:33:01.791900 (+ 2406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:01.791906 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:01.792012 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:01.792149 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:01.794758 (+ 2609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:01.795887 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:01.798988 (+ 3101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:01.799433 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:01.799587 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:01.806143 (+ 6556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:01.806153 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:01.806161 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:01.806227 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:01.810573 (+ 4346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:01.811898 (+ 1325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:01.811905 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:01.811908 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:01.812084 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:01.812626 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:01.812631 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:01.812635 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:01.813024 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:01.813215 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:01.814072 (+ 857us) server_negotiation.cc:299] Negotiation successful
0808 23:33:01.814357 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":254,"threads_started":1}
I20260808 23:33:01.815980 29541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:01.788339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40521 (local address 127.26.207.194:45743)
0808 23:33:01.789300 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:01.789360 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:01.791515 (+ 2155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:01.792436 (+ 921us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:01.792446 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:01.793367 (+ 921us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:01.794509 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:01.794546 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:01.796065 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:01.796071 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:01.798728 (+ 2657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:01.798760 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:01.799742 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:01.799752 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:01.800327 (+ 575us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:01.801307 (+ 980us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:01.801335 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:01.805645 (+ 4310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:01.810863 (+ 5218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:01.810881 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:01.810909 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:01.811721 (+ 812us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:01.812227 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:01.812232 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:01.812234 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:01.812483 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:01.813182 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:01.813191 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:01.813634 (+ 443us) client_negotiation.cc:769] Sending connection context
0808 23:33:01.813938 (+ 304us) client_negotiation.cc:240] Negotiation successful
0808 23:33:01.814564 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":420,"threads_started":1}
I20260808 23:33:01.848017 29515 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:36583
I20260808 23:33:01.848098 29657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:36583 every 8 connection(s)
I20260808 23:33:01.848351 29539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:01.828364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:38979 (local address 127.26.207.254:40521)
0808 23:33:01.828648 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:01.828657 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:01.829281 (+ 624us) server_negotiation.cc:407] Connection header received
0808 23:33:01.829580 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:01.829585 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:01.829662 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:01.829762 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:01.831873 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:01.832673 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:01.835714 (+ 3041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:01.836284 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:01.836427 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:01.839645 (+ 3218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:01.839652 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:01.839655 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:01.839695 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:01.844155 (+ 4460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:01.845131 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:01.845136 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:01.845139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:01.845344 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:01.845924 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:01.845928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:01.845930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:01.846339 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:01.846475 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:01.847661 (+ 1186us) server_negotiation.cc:299] Negotiation successful
0808 23:33:01.847976 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 23:33:01.848702 29622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:01.828252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40521 (local address 127.26.207.194:38979)
0808 23:33:01.829074 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:01.829102 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:01.829349 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:01.830121 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:01.830130 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:01.831037 (+ 907us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:01.831596 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:01.831619 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:01.832946 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:01.832960 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:01.835455 (+ 2495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:01.835486 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:01.836553 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:01.836564 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:01.836882 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:01.837834 (+ 952us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:01.837858 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:01.839331 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:01.844369 (+ 5038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:01.844381 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:01.844384 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:01.844961 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:01.845511 (+ 550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:01.845518 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:01.845527 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:01.845768 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:01.846493 (+ 725us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:01.846499 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:01.846812 (+ 313us) client_negotiation.cc:769] Sending connection context
0808 23:33:01.847018 (+ 206us) client_negotiation.cc:240] Negotiation successful
0808 23:33:01.847630 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":382,"threads_started":1}
I20260808 23:33:01.850063 29515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:33:01.851258 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 29515
I20260808 23:33:01.851449 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:33:01.852021 27455 external_mini_cluster.cc:1428] Setting key 888e847ea9917782e1f896c7508191de
I20260808 23:33:01.853847 29658 heartbeater.cc:347] Connected to a master server at 127.26.207.254:40521
I20260808 23:33:01.854213 29658 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:01.855412 29658 heartbeater.cc:511] Master 127.26.207.254:40521 requested a full tablet report, sending...
I20260808 23:33:01.857630 29289 ts_manager.cc:194] Registered new tserver with Master: a09d2990e8af4696984a7e5ae4415212 (127.26.207.194:36583)
I20260808 23:33:01.858752 29289 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:45743
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:33:01.909392 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:40521
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:02.267204 29662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:02.267553 29662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:02.267737 29662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:02.275561 29662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:02.275750 29662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:02.275936 29662 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 23:33:02.276031 29662 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 23:33:02.276166 29662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:33:02.278520 29511 heartbeater.cc:503] Master 127.26.207.254:40521 was elected leader, sending a full tablet report...
I20260808 23:33:02.287783 29662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.207.254:40521
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:02.289364 29662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:02.290783 29662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:02.305524 29668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:02.305488 29670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:02.305687 29667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:02.306841 29662 server_base.cc:1034] running on GCE node
I20260808 23:33:02.307611 29662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:02.308745 29662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:02.310051 29662 hybrid_clock.cc:648] HybridClock initialized: now 1786231982309997 us; error 51 us; skew 500 ppm
I20260808 23:33:02.310483 29662 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:02 dist-test-slave-1x4g krb5kdc[29243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231982, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:02.314280 29662 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:33:02.316156 29662 webserver.cc:460] Webserver started at http://127.26.207.195:44735/ using document root <none> and password file <none>
I20260808 23:33:02.317078 29662 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:02.317245 29662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:02.317622 29662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:02.321058 29662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "b782467b568048c7ace5c67f7a7a8efd"
format_stamp: "Formatted at 2026-08-08 23:33:02 on dist-test-slave-1x4g"
server_key: "afeb24b8c14482d54ff2a0fb1a260bb8"
server_key_iv: "0b99deb834acf66eb7bb8e3d0deeb9a6"
server_key_version: "encryptionkey@0"
I20260808 23:33:02.321978 29662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "b782467b568048c7ace5c67f7a7a8efd"
format_stamp: "Formatted at 2026-08-08 23:33:02 on dist-test-slave-1x4g"
server_key: "afeb24b8c14482d54ff2a0fb1a260bb8"
server_key_iv: "0b99deb834acf66eb7bb8e3d0deeb9a6"
server_key_version: "encryptionkey@0"
I20260808 23:33:02.328292 29662 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 23:33:02.333161 29677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:02.334846 29662 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 23:33:02.335078 29662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "b782467b568048c7ace5c67f7a7a8efd"
format_stamp: "Formatted at 2026-08-08 23:33:02 on dist-test-slave-1x4g"
server_key: "afeb24b8c14482d54ff2a0fb1a260bb8"
server_key_iv: "0b99deb834acf66eb7bb8e3d0deeb9a6"
server_key_version: "encryptionkey@0"
I20260808 23:33:02.335346 29662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:02.354285 29662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:02.359364 29662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:02.359712 29662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:02.362828 29662 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:02.362972 29662 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:02.363157 29662 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:02.363274 29662 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 23:33:02 dist-test-slave-1x4g krb5kdc[29243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231982, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:02.389950 29686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:02.363376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:51761 (local address 127.26.207.254:40521)
0808 23:33:02.364246 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:02.364253 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:02.365370 (+ 1117us) server_negotiation.cc:407] Connection header received
0808 23:33:02.367833 (+ 2463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:02.367840 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:02.367962 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:02.368130 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:02.370983 (+ 2853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.372124 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.375298 (+ 3174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.375972 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.376140 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:02.382120 (+ 5980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:02.382130 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:02.382138 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:02.382185 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:02.385571 (+ 3386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:02.386886 (+ 1315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:02.386895 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:02.386901 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:02.387120 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:02.387647 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:02.387654 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:02.387661 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:02.388172 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:02.388366 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:02.389263 (+ 897us) server_negotiation.cc:299] Negotiation successful
0808 23:33:02.389530 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":736,"thread_start_us":597,"threads_started":1}
I20260808 23:33:02.391211 29687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:02.364136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40521 (local address 127.26.207.195:51761)
0808 23:33:02.365177 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:02.365232 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:02.367425 (+ 2193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:02.368499 (+ 1074us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:02.368516 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:02.369520 (+ 1004us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:02.370728 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:02.370757 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.372413 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.372421 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:02.375071 (+ 2650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:02.375094 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.376268 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.376276 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:02.376695 (+ 419us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:02.377791 (+ 1096us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:02.377817 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:02.381689 (+ 3872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:02.385811 (+ 4122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:02.385820 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:02.385836 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:02.386663 (+ 827us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:02.387268 (+ 605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:02.387273 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:02.387277 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:02.387497 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:02.388328 (+ 831us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:02.388334 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:02.388734 (+ 400us) client_negotiation.cc:769] Sending connection context
0808 23:33:02.389143 (+ 409us) client_negotiation.cc:240] Negotiation successful
0808 23:33:02.389796 (+ 653us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":724,"thread_start_us":419,"threads_started":1}
I20260808 23:33:02.419124 29686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:02.397673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:55461 (local address 127.26.207.254:40521)
0808 23:33:02.397921 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:02.397932 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:02.402221 (+ 4289us) server_negotiation.cc:407] Connection header received
0808 23:33:02.402473 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:02.402478 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:02.402579 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:02.402672 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:02.404361 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.405214 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.408092 (+ 2878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.408909 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.409082 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:02.412223 (+ 3141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:02.412229 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:02.412233 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:02.412270 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:02.416008 (+ 3738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:02.416874 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:02.416881 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:02.416885 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:02.417034 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:02.417455 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:02.417461 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:02.417464 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:02.417843 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:02.418009 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:02.418467 (+ 458us) server_negotiation.cc:299] Negotiation successful
0808 23:33:02.418738 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 23:33:02.419240 29735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:02.397642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40521 (local address 127.26.207.195:55461)
0808 23:33:02.402042 (+ 4400us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:02.402074 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:02.402315 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:02.402759 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:02.402767 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:02.403585 (+ 818us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:02.404151 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:02.404172 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.405477 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.405484 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:02.407822 (+ 2338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:02.407857 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.409437 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.409444 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:02.409771 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:02.410686 (+ 915us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:02.410722 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:02.411922 (+ 1200us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:02.416200 (+ 4278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:02.416206 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:02.416210 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:02.416696 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:02.417181 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:02.417189 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:02.417197 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:02.417335 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:02.417977 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:02.417981 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:02.418187 (+ 206us) client_negotiation.cc:769] Sending connection context
0808 23:33:02.418341 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 23:33:02.418756 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4152,"thread_start_us":3838,"threads_started":1}
I20260808 23:33:02.433781 29662 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:37601
I20260808 23:33:02.433800 29802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:37601 every 8 connection(s)
I20260808 23:33:02.435678 29662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:33:02.443781 29803 heartbeater.cc:347] Connected to a master server at 127.26.207.254:40521
I20260808 23:33:02.444199 29803 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:02.445092 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 29662
I20260808 23:33:02.445283 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:33:02.445308 29803 heartbeater.cc:511] Master 127.26.207.254:40521 requested a full tablet report, sending...
I20260808 23:33:02.445931 27455 external_mini_cluster.cc:1428] Setting key 85c10e92eb6ea8ff65d88ad1300c2192
I20260808 23:33:02.447232 29289 ts_manager.cc:194] Registered new tserver with Master: b782467b568048c7ace5c67f7a7a8efd (127.26.207.195:37601)
I20260808 23:33:02.448098 29289 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:51761
I20260808 23:33:02.451633 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 23:33:02 dist-test-slave-1x4g krb5kdc[29243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 23:33:02 dist-test-slave-1x4g krb5kdc[29243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:02.520030 29686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:02.503693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45744 (local address 127.26.207.254:40521)
0808 23:33:02.503948 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:02.503957 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:02.504262 (+ 305us) server_negotiation.cc:407] Connection header received
0808 23:33:02.504523 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:02.504527 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:02.504613 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:02.504733 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:02.506353 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.507120 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.508504 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.509000 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.509147 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:02.513785 (+ 4638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:02.513791 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:02.513794 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:02.513839 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:02.516706 (+ 2867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:02.517566 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:02.517574 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:02.517582 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:02.517792 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:02.518254 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:02.518260 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:02.518264 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:02.518665 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:02.518964 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:02.519331 (+ 367us) server_negotiation.cc:299] Negotiation successful
0808 23:33:02.519639 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 23:33:02.524829 29289 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45744:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:33:02.534015 29289 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:33:02.562789 29819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:02.549989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:36913 (local address 127.0.0.1:57762)
0808 23:33:02.551367 (+ 1378us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:02.551409 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:02.551628 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:02.553942 (+ 2314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:02.553953 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:02.554001 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:02.554595 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:02.554617 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.556652 (+ 2035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.556657 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:02.559264 (+ 2607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:02.559283 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.561585 (+ 2302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.561592 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:02.561861 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:02.561929 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 23:33:02.562071 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 23:33:02.562302 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1121,"mutex_wait_us":31,"thread_start_us":4284,"threads_started":1}
I20260808 23:33:02.564103 29820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:02.550905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42776 (local address 127.26.207.194:36583)
0808 23:33:02.552286 (+ 1381us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:02.552301 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:02.554780 (+ 2479us) server_negotiation.cc:407] Connection header received
0808 23:33:02.555125 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:02.555133 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:02.555414 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:02.555607 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:02.556632 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.558234 (+ 1602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.561030 (+ 2796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.562514 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.562672 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:02.562890 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:02.563581 (+ 691us) server_negotiation.cc:299] Negotiation successful
0808 23:33:02.563803 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1139,"thread_start_us":979,"threads_started":1}
I20260808 23:33:02.564904 29817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:02.550040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57762 (local address 127.26.207.193:36913)
0808 23:33:02.553290 (+ 3250us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:02.553297 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:02.553326 (+ 29us) server_negotiation.cc:407] Connection header received
0808 23:33:02.553425 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:02.553432 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:02.553658 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:02.553895 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:02.554851 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.556458 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.559561 (+ 3103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.561301 (+ 1740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.563760 (+ 2459us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:02.563963 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:02.564057 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 23:33:02.564499 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3089,"thread_start_us":2942,"threads_started":1}
I20260808 23:33:02.565104 29818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:02.550577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:36583 (local address 127.0.0.1:42776)
0808 23:33:02.554644 (+ 4067us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:02.554669 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:02.554905 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:02.555876 (+ 971us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:02.555882 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:02.555909 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:02.556376 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:02.556390 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.558458 (+ 2068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.558464 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:02.560797 (+ 2333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:02.560818 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.563122 (+ 2304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.563129 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:02.563323 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:02.563358 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 23:33:02.564431 (+ 1073us) client_negotiation.cc:240] Negotiation successful
0808 23:33:02.564604 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3878,"mutex_wait_us":1,"thread_start_us":383,"threads_started":1}
I20260808 23:33:02.569998 29583 tablet_service.cc:1467] Processing CreateTablet for tablet b7bf18a178564c97867b20c52fa4c718 (DEFAULT_TABLE table=test-table [id=ca63d64f9be9492fb54d11a2a1b5c9f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:02.571503 29583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7bf18a178564c97867b20c52fa4c718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:02.571902 29435 tablet_service.cc:1467] Processing CreateTablet for tablet b7bf18a178564c97867b20c52fa4c718 (DEFAULT_TABLE table=test-table [id=ca63d64f9be9492fb54d11a2a1b5c9f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:02.573643 29435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7bf18a178564c97867b20c52fa4c718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:02.574332 29819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:02.555873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:37601 (local address 127.0.0.1:55164)
0808 23:33:02.563379 (+ 7506us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:02.563402 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:02.563521 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:02.566983 (+ 3462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:02.566992 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:02.567040 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:02.567330 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:02.567349 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.569173 (+ 1824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.569180 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:02.571112 (+ 1932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:02.571146 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.573416 (+ 2270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.573426 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:02.573650 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:02.573691 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 23:33:02.573807 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 23:33:02.574014 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7398,"thread_start_us":11496,"threads_started":1}
I20260808 23:33:02.575212 29821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:02.555114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55164 (local address 127.26.207.195:37601)
0808 23:33:02.566222 (+ 11108us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:02.566230 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:02.566267 (+ 37us) server_negotiation.cc:407] Connection header received
0808 23:33:02.566383 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:02.566391 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:02.566686 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:02.566937 (+ 251us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:02.567622 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.568963 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.571485 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.573158 (+ 1673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.573416 (+ 258us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:02.573613 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:02.574624 (+ 1011us) server_negotiation.cc:299] Negotiation successful
0808 23:33:02.574832 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10921,"thread_start_us":10653,"threads_started":1}
I20260808 23:33:02.581571 29729 tablet_service.cc:1467] Processing CreateTablet for tablet b7bf18a178564c97867b20c52fa4c718 (DEFAULT_TABLE table=test-table [id=ca63d64f9be9492fb54d11a2a1b5c9f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:02.583959 29729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7bf18a178564c97867b20c52fa4c718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:02.586614 29823 tablet_bootstrap.cc:492] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212: Bootstrap starting.
I20260808 23:33:02.590138 29823 tablet_bootstrap.cc:654] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:02.591122 29824 tablet_bootstrap.cc:492] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e: Bootstrap starting.
I20260808 23:33:02.591663 29823 log.cc:824] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:02.595762 29824 tablet_bootstrap.cc:654] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:02.596912 29823 tablet_bootstrap.cc:492] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212: No bootstrap required, opened a new log
I20260808 23:33:02.597287 29823 ts_tablet_manager.cc:1397] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260808 23:33:02.597386 29824 log.cc:824] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:02.600980 29827 tablet_bootstrap.cc:492] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd: Bootstrap starting.
I20260808 23:33:02.601315 29824 tablet_bootstrap.cc:492] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e: No bootstrap required, opened a new log
I20260808 23:33:02.601660 29824 ts_tablet_manager.cc:1397] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260808 23:33:02.605162 29827 tablet_bootstrap.cc:654] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:02.606374 29827 log.cc:824] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:02.609264 29823 raft_consensus.cc:348] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:02.609843 29823 raft_consensus.cc:374] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:02.609974 29823 raft_consensus.cc:729] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09d2990e8af4696984a7e5ae4415212, State: Initialized, Role: FOLLOWER
I20260808 23:33:02.610735 29823 consensus_queue.cc:260] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:02.611934 29827 tablet_bootstrap.cc:492] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd: No bootstrap required, opened a new log
I20260808 23:33:02.612129 29658 heartbeater.cc:503] Master 127.26.207.254:40521 was elected leader, sending a full tablet report...
I20260808 23:33:02.612273 29827 ts_tablet_manager.cc:1397] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.003s
I20260808 23:33:02.612957 29823 ts_tablet_manager.cc:1428] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212: Time spent starting tablet: real 0.016s user 0.010s sys 0.006s
I20260808 23:33:02.614876 29824 raft_consensus.cc:348] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:02.615418 29824 raft_consensus.cc:374] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:02.615561 29824 raft_consensus.cc:729] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39850fc924294e83a6161a5f80efe85e, State: Initialized, Role: FOLLOWER
I20260808 23:33:02.616321 29824 consensus_queue.cc:260] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:02.621630 29827 raft_consensus.cc:348] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:02.622247 29827 raft_consensus.cc:374] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:02.622366 29827 raft_consensus.cc:729] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b782467b568048c7ace5c67f7a7a8efd, State: Initialized, Role: FOLLOWER
I20260808 23:33:02.622637 29824 ts_tablet_manager.cc:1428] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e: Time spent starting tablet: real 0.021s user 0.015s sys 0.004s
I20260808 23:33:02.623106 29827 consensus_queue.cc:260] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:02.624429 29803 heartbeater.cc:503] Master 127.26.207.254:40521 was elected leader, sending a full tablet report...
I20260808 23:33:02.625265 29827 ts_tablet_manager.cc:1428] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd: Time spent starting tablet: real 0.013s user 0.014s sys 0.001s
W20260808 23:33:02.688436 29804 tablet.cc:2369] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:33:02.770188 29512 tablet.cc:2369] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:33:02.858645 29659 tablet.cc:2369] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:33:02.955891 29829 raft_consensus.cc:482] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:33:02.956290 29829 raft_consensus.cc:504] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:02.958235 29829 leader_election.cc:288] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39850fc924294e83a6161a5f80efe85e (127.26.207.193:36913), b782467b568048c7ace5c67f7a7a8efd (127.26.207.195:37601)
I20260808 23:33:02.967455 29821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:02.960027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:38503 (local address 127.26.207.195:37601)
0808 23:33:02.960252 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:02.960257 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:02.960562 (+ 305us) server_negotiation.cc:407] Connection header received
0808 23:33:02.960831 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:02.960840 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:02.960917 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:02.961025 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:02.961621 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.962359 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.964802 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.966115 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.966305 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:02.966387 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:02.967017 (+ 630us) server_negotiation.cc:299] Negotiation successful
0808 23:33:02.967173 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 23:33:02.967456 29817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:02.958787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:41105 (local address 127.26.207.193:36913)
0808 23:33:02.959033 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:02.959038 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:02.959793 (+ 755us) server_negotiation.cc:407] Connection header received
0808 23:33:02.960007 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:02.960013 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:02.960117 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:02.960234 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:02.961008 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.961986 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.964829 (+ 2843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.966135 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.966305 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:02.966387 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:02.967017 (+ 630us) server_negotiation.cc:299] Negotiation successful
0808 23:33:02.967173 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 23:33:02.967658 29833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:02.959776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:37601 (local address 127.26.207.194:38503)
0808 23:33:02.960432 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:02.960448 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:02.960619 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:02.961041 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:02.961045 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:02.961075 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:02.961429 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:02.961441 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.962489 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.962494 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:02.964581 (+ 2087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:02.964595 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.966450 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.966459 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:02.966741 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:02.966798 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 23:33:02.966917 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 23:33:02.967131 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"mutex_wait_us":84,"thread_start_us":344,"threads_started":1}
I20260808 23:33:02.967933 29832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:02.958818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:36913 (local address 127.26.207.194:41105)
0808 23:33:02.959637 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:02.959661 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:02.959826 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:02.960368 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:02.960375 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:02.960416 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:02.960768 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:02.960837 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.962132 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.962137 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:02.964480 (+ 2343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:02.964503 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:02.966469 (+ 1966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:02.966476 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:02.966684 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:02.966799 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 23:33:02.966917 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 23:33:02.967131 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"mutex_wait_us":114,"thread_start_us":407,"threads_started":1}
I20260808 23:33:02.968927 29755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7bf18a178564c97867b20c52fa4c718" candidate_uuid: "a09d2990e8af4696984a7e5ae4415212" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b782467b568048c7ace5c67f7a7a8efd" is_pre_election: true
I20260808 23:33:02.968962 29463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7bf18a178564c97867b20c52fa4c718" candidate_uuid: "a09d2990e8af4696984a7e5ae4415212" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39850fc924294e83a6161a5f80efe85e" is_pre_election: true
I20260808 23:33:02.969448 29755 raft_consensus.cc:2454] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09d2990e8af4696984a7e5ae4415212 in term 0.
I20260808 23:33:02.969481 29463 raft_consensus.cc:2454] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09d2990e8af4696984a7e5ae4415212 in term 0.
I20260808 23:33:02.970160 29533 leader_election.cc:302] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a09d2990e8af4696984a7e5ae4415212, b782467b568048c7ace5c67f7a7a8efd; no voters:
I20260808 23:33:02.970655 29829 raft_consensus.cc:2781] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:33:02.970845 29829 raft_consensus.cc:482] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:33:02.970966 29829 raft_consensus.cc:3037] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:02.973667 29829 raft_consensus.cc:504] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:02.974391 29829 leader_election.cc:288] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [CANDIDATE]: Term 1 election: Requested vote from peers 39850fc924294e83a6161a5f80efe85e (127.26.207.193:36913), b782467b568048c7ace5c67f7a7a8efd (127.26.207.195:37601)
I20260808 23:33:02.975067 29463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7bf18a178564c97867b20c52fa4c718" candidate_uuid: "a09d2990e8af4696984a7e5ae4415212" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39850fc924294e83a6161a5f80efe85e"
I20260808 23:33:02.975174 29755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7bf18a178564c97867b20c52fa4c718" candidate_uuid: "a09d2990e8af4696984a7e5ae4415212" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b782467b568048c7ace5c67f7a7a8efd"
I20260808 23:33:02.975313 29463 raft_consensus.cc:3037] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:02.975505 29755 raft_consensus.cc:3037] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:02.978080 29463 raft_consensus.cc:2454] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09d2990e8af4696984a7e5ae4415212 in term 1.
I20260808 23:33:02.978130 29755 raft_consensus.cc:2454] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09d2990e8af4696984a7e5ae4415212 in term 1.
I20260808 23:33:02.978658 29533 leader_election.cc:302] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39850fc924294e83a6161a5f80efe85e, a09d2990e8af4696984a7e5ae4415212; no voters:
I20260808 23:33:02.979054 29829 raft_consensus.cc:2781] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:02.979501 29829 raft_consensus.cc:686] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [term 1 LEADER]: Becoming Leader. State: Replica: a09d2990e8af4696984a7e5ae4415212, State: Running, Role: LEADER
I20260808 23:33:02.980130 29829 consensus_queue.cc:237] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:02.985642 29290 catalog_manager.cc:5495] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09d2990e8af4696984a7e5ae4415212 (127.26.207.194). New cstate: current_term: 1 leader_uuid: "a09d2990e8af4696984a7e5ae4415212" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } health_report { overall_health: UNKNOWN } } }
Aug 08 23:33:03 dist-test-slave-1x4g krb5kdc[29243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231980, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:03.060155 29843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:03.039256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40521 (local address 127.0.0.1:45754)
0808 23:33:03.040223 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:03.040252 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:03.040398 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:03.040767 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:03.040806 (+ 39us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:03.041574 (+ 768us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:03.041824 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:03.041835 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.042990 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.042998 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:03.044012 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:03.044024 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.044766 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.044802 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:03.045005 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:03.050456 (+ 5451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:03.050479 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:03.053255 (+ 2776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:03.057600 (+ 4345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:03.057616 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:03.057623 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:03.058135 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:03.058532 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:03.058536 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:03.058538 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:03.058677 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:03.059224 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:03.059231 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:03.059413 (+ 182us) client_negotiation.cc:769] Sending connection context
0808 23:33:03.059576 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 23:33:03.059820 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":807,"thread_start_us":620,"threads_started":1}
I20260808 23:33:03.060447 29842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:03.039270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45754 (local address 127.26.207.254:40521)
0808 23:33:03.039903 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:03.039908 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:03.040340 (+ 432us) server_negotiation.cc:407] Connection header received
0808 23:33:03.040542 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:03.040546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:03.040603 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:03.040712 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:03.042005 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.042838 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.044161 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.044564 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.044696 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:03.053581 (+ 8885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:03.053588 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:03.053593 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:03.053636 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:03.057416 (+ 3780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:03.058272 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:03.058276 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:03.058278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:03.058427 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:03.058773 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:03.058776 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:03.058778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:03.059085 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:03.059201 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:03.059676 (+ 475us) server_negotiation.cc:299] Negotiation successful
0808 23:33:03.059966 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":87,"server-negotiator.queue_time_us":493,"thread_start_us":304,"threads_started":1}
I20260808 23:33:03.066326 29290 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:45754:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 23:33:03.067477 29290 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:33:03.075089 29583 tablet_service.cc:1467] Processing CreateTablet for tablet 9246b6b438a647b19442cab2887f45b7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5e42e9b43c464b7aa51a060ef985a142]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 23:33:03.075029 29435 tablet_service.cc:1467] Processing CreateTablet for tablet 9246b6b438a647b19442cab2887f45b7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5e42e9b43c464b7aa51a060ef985a142]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 23:33:03.076180 29583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9246b6b438a647b19442cab2887f45b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:03.076180 29435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9246b6b438a647b19442cab2887f45b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:03.077481 29729 tablet_service.cc:1467] Processing CreateTablet for tablet 9246b6b438a647b19442cab2887f45b7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5e42e9b43c464b7aa51a060ef985a142]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 23:33:03.078351 29729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9246b6b438a647b19442cab2887f45b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:03.084649 29823 tablet_bootstrap.cc:492] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212: Bootstrap starting.
I20260808 23:33:03.085022 29824 tablet_bootstrap.cc:492] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e: Bootstrap starting.
I20260808 23:33:03.085320 29827 tablet_bootstrap.cc:492] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd: Bootstrap starting.
I20260808 23:33:03.086658 29824 tablet_bootstrap.cc:654] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:03.087304 29827 tablet_bootstrap.cc:654] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:03.087622 29823 tablet_bootstrap.cc:654] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:03.095328 29824 tablet_bootstrap.cc:492] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e: No bootstrap required, opened a new log
I20260808 23:33:03.095541 29824 ts_tablet_manager.cc:1397] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260808 23:33:03.095921 29823 tablet_bootstrap.cc:492] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212: No bootstrap required, opened a new log
I20260808 23:33:03.096100 29823 ts_tablet_manager.cc:1397] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.008s
I20260808 23:33:03.096306 29827 tablet_bootstrap.cc:492] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd: No bootstrap required, opened a new log
I20260808 23:33:03.096472 29824 raft_consensus.cc:348] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.096757 29824 raft_consensus.cc:374] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:03.096746 29827 ts_tablet_manager.cc:1397] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20260808 23:33:03.096884 29824 raft_consensus.cc:729] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39850fc924294e83a6161a5f80efe85e, State: Initialized, Role: FOLLOWER
I20260808 23:33:03.097012 29823 raft_consensus.cc:348] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.097256 29823 raft_consensus.cc:374] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:03.097178 29824 consensus_queue.cc:260] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.097352 29823 raft_consensus.cc:729] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09d2990e8af4696984a7e5ae4415212, State: Initialized, Role: FOLLOWER
I20260808 23:33:03.097573 29823 consensus_queue.cc:260] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.097584 29827 raft_consensus.cc:348] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.097854 29827 raft_consensus.cc:374] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:03.097652 29830 tablet_replica.cc:439] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } } }
I20260808 23:33:03.097956 29827 raft_consensus.cc:729] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b782467b568048c7ace5c67f7a7a8efd, State: Initialized, Role: FOLLOWER
I20260808 23:33:03.098059 29830 tablet_replica.cc:442] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:33:03.098196 29823 ts_tablet_manager.cc:1428] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 23:33:03.098201 29827 consensus_queue.cc:260] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.098594 29829 tablet_replica.cc:439] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } } }
I20260808 23:33:03.098798 29827 ts_tablet_manager.cc:1428] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 23:33:03.098878 29829 tablet_replica.cc:442] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:33:03.098953 29831 tablet_replica.cc:439] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } } }
I20260808 23:33:03.099301 29831 tablet_replica.cc:442] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:33:03.100065 29824 ts_tablet_manager.cc:1428] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260808 23:33:03.119174 29830 raft_consensus.cc:482] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:33:03.119498 29830 raft_consensus.cc:504] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.121294 29830 leader_election.cc:288] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09d2990e8af4696984a7e5ae4415212 (127.26.207.194:36583), b782467b568048c7ace5c67f7a7a8efd (127.26.207.195:37601)
I20260808 23:33:03.130332 29821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:03.121788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:49507 (local address 127.26.207.195:37601)
0808 23:33:03.122033 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:03.122043 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:03.123738 (+ 1695us) server_negotiation.cc:407] Connection header received
0808 23:33:03.123879 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:03.123883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:03.123961 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:03.124072 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:03.124800 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.125802 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.127906 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.129198 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.129380 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:03.129499 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:03.129879 (+ 380us) server_negotiation.cc:299] Negotiation successful
0808 23:33:03.130036 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 23:33:03.130544 29849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:03.121702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:36583 (local address 127.26.207.193:59857)
0808 23:33:03.123030 (+ 1328us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:03.123060 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:03.123278 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:03.123759 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:03.124086 (+ 327us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:03.124116 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:03.124929 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:03.124944 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.126229 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.126233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:03.127763 (+ 1530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:03.127777 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.129578 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.129585 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:03.129746 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:03.129788 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 23:33:03.129873 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 23:33:03.129985 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1121,"mutex_wait_us":46,"thread_start_us":1503,"threads_started":1}
I20260808 23:33:03.130568 29848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:03.121933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:37601 (local address 127.26.207.193:49507)
0808 23:33:03.123581 (+ 1648us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:03.123606 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:03.123734 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:03.124134 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:03.124138 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:03.124167 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:03.124548 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:03.124567 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.125973 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.125981 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:03.127662 (+ 1681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:03.127709 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.129445 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.129451 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:03.129663 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:03.129708 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 23:33:03.129820 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 23:33:03.129986 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1499,"mutex_wait_us":27,"thread_start_us":582,"threads_started":1}
I20260808 23:33:03.130411 29847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:03.121679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:59857 (local address 127.26.207.194:36583)
0808 23:33:03.123333 (+ 1654us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:03.123342 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:03.123366 (+ 24us) server_negotiation.cc:407] Connection header received
0808 23:33:03.123455 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:03.123460 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:03.123542 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:03.123696 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:03.125154 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.126062 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.128035 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.129353 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.129526 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:03.129591 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:03.129914 (+ 323us) server_negotiation.cc:299] Negotiation successful
0808 23:33:03.130088 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1488,"thread_start_us":1301,"threads_started":1}
I20260808 23:33:03.131330 29755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9246b6b438a647b19442cab2887f45b7" candidate_uuid: "39850fc924294e83a6161a5f80efe85e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b782467b568048c7ace5c67f7a7a8efd" is_pre_election: true
I20260808 23:33:03.131615 29755 raft_consensus.cc:2454] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39850fc924294e83a6161a5f80efe85e in term 0.
I20260808 23:33:03.131834 29606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9246b6b438a647b19442cab2887f45b7" candidate_uuid: "39850fc924294e83a6161a5f80efe85e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09d2990e8af4696984a7e5ae4415212" is_pre_election: true
I20260808 23:33:03.132225 29382 leader_election.cc:302] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39850fc924294e83a6161a5f80efe85e, b782467b568048c7ace5c67f7a7a8efd; no voters:
I20260808 23:33:03.132314 29606 raft_consensus.cc:2454] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39850fc924294e83a6161a5f80efe85e in term 0.
I20260808 23:33:03.132822 29830 raft_consensus.cc:2781] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:33:03.132992 29830 raft_consensus.cc:482] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:33:03.133100 29830 raft_consensus.cc:3037] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:03.135509 29830 raft_consensus.cc:504] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.136256 29830 leader_election.cc:288] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [CANDIDATE]: Term 1 election: Requested vote from peers a09d2990e8af4696984a7e5ae4415212 (127.26.207.194:36583), b782467b568048c7ace5c67f7a7a8efd (127.26.207.195:37601)
I20260808 23:33:03.136894 29755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9246b6b438a647b19442cab2887f45b7" candidate_uuid: "39850fc924294e83a6161a5f80efe85e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b782467b568048c7ace5c67f7a7a8efd"
I20260808 23:33:03.137182 29755 raft_consensus.cc:3037] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:03.137226 29606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9246b6b438a647b19442cab2887f45b7" candidate_uuid: "39850fc924294e83a6161a5f80efe85e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09d2990e8af4696984a7e5ae4415212"
I20260808 23:33:03.137501 29606 raft_consensus.cc:3037] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:03.139380 29755 raft_consensus.cc:2454] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39850fc924294e83a6161a5f80efe85e in term 1.
I20260808 23:33:03.139889 29382 leader_election.cc:302] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39850fc924294e83a6161a5f80efe85e, b782467b568048c7ace5c67f7a7a8efd; no voters:
I20260808 23:33:03.139971 29606 raft_consensus.cc:2454] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39850fc924294e83a6161a5f80efe85e in term 1.
I20260808 23:33:03.140252 29830 raft_consensus.cc:2781] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:03.140899 29830 raft_consensus.cc:686] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [term 1 LEADER]: Becoming Leader. State: Replica: 39850fc924294e83a6161a5f80efe85e, State: Running, Role: LEADER
I20260808 23:33:03.141500 29830 consensus_queue.cc:237] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.145609 29850 tablet_replica.cc:439] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e: TxnStatusTablet state changed. Reason: New leader 39850fc924294e83a6161a5f80efe85e. Latest consensus state: current_term: 1 leader_uuid: "39850fc924294e83a6161a5f80efe85e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } } }
I20260808 23:33:03.146073 29850 tablet_replica.cc:442] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e: This TxnStatusTablet replica's current role is: LEADER
I20260808 23:33:03.146924 29852 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 23:33:03.147254 29852 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 23:33:03.147258 29289 catalog_manager.cc:5495] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e reported cstate change: term changed from 0 to 1, leader changed from <none> to 39850fc924294e83a6161a5f80efe85e (127.26.207.193). New cstate: current_term: 1 leader_uuid: "39850fc924294e83a6161a5f80efe85e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } health_report { overall_health: UNKNOWN } } }
I20260808 23:33:03.181548 29843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:03.174426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:36913 (local address 127.0.0.1:57778)
0808 23:33:03.174722 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:03.174748 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:03.174930 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:03.175454 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:03.175460 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:03.175475 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 23:33:03.175674 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:03.175685 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.176854 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.176860 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:03.178566 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:03.178586 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.179357 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.179364 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:03.179607 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:03.179707 (+ 100us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 23:33:03.180719 (+ 1012us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 23:33:03.180747 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 23:33:03.180894 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 23:33:03.181095 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 23:33:03.181592 29817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:03.174501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57778 (local address 127.26.207.193:36913)
0808 23:33:03.174712 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:03.174717 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:03.174832 (+ 115us) server_negotiation.cc:407] Connection header received
0808 23:33:03.175165 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:03.175169 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:03.175251 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:03.175370 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:03.175818 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.176687 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.178727 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.179173 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.179274 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:03.179913 (+ 639us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:03.180598 (+ 685us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:03.180764 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:03.180920 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 23:33:03.181015 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 23:33:03.191562 29755 raft_consensus.cc:1261] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Refusing update from remote peer 39850fc924294e83a6161a5f80efe85e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:03.191680 29606 raft_consensus.cc:1261] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Refusing update from remote peer 39850fc924294e83a6161a5f80efe85e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:03.192663 29850 consensus_queue.cc:1035] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:03.193202 29830 consensus_queue.cc:1035] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:03.202605 29831 tablet_replica.cc:439] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd: TxnStatusTablet state changed. Reason: New leader 39850fc924294e83a6161a5f80efe85e. Latest consensus state: current_term: 1 leader_uuid: "39850fc924294e83a6161a5f80efe85e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } } }
I20260808 23:33:03.202948 29831 tablet_replica.cc:442] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:33:03.205655 29855 mvcc.cc:205] Tried to move back new op lower bound from 7316406203141718016 to 7316406202951512064. Current Snapshot: MvccSnapshot[applied={T|T < 7316406203141718016}]
I20260808 23:33:03.216034 29829 tablet_replica.cc:439] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212: TxnStatusTablet state changed. Reason: New leader 39850fc924294e83a6161a5f80efe85e. Latest consensus state: current_term: 1 leader_uuid: "39850fc924294e83a6161a5f80efe85e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } } }
I20260808 23:33:03.216559 29829 tablet_replica.cc:442] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:33:03.220686 29850 tablet_replica.cc:439] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39850fc924294e83a6161a5f80efe85e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } } }
I20260808 23:33:03.221035 29850 tablet_replica.cc:442] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e: This TxnStatusTablet replica's current role is: LEADER
I20260808 23:33:03.221590 29831 tablet_replica.cc:439] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39850fc924294e83a6161a5f80efe85e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } } }
I20260808 23:33:03.221866 29831 tablet_replica.cc:442] T 9246b6b438a647b19442cab2887f45b7 P b782467b568048c7ace5c67f7a7a8efd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:33:03.225384 29830 tablet_replica.cc:439] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39850fc924294e83a6161a5f80efe85e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } } }
I20260808 23:33:03.225728 29830 tablet_replica.cc:442] T 9246b6b438a647b19442cab2887f45b7 P 39850fc924294e83a6161a5f80efe85e: This TxnStatusTablet replica's current role is: LEADER
I20260808 23:33:03.239626 29829 tablet_replica.cc:439] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39850fc924294e83a6161a5f80efe85e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } } }
I20260808 23:33:03.239979 29829 tablet_replica.cc:442] T 9246b6b438a647b19442cab2887f45b7 P a09d2990e8af4696984a7e5ae4415212: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:33:03.250046 29847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:03.243261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42782 (local address 127.26.207.194:36583)
0808 23:33:03.243509 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:03.243517 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:03.244235 (+ 718us) server_negotiation.cc:407] Connection header received
0808 23:33:03.244464 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:03.244467 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:03.244552 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:03.244691 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:03.245328 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.246064 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.247623 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.248055 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.248201 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:03.248709 (+ 508us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:03.249369 (+ 660us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:03.249549 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:03.249652 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 23:33:03.249750 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 23:33:03.270632 29817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:03.263507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:53509 (local address 127.26.207.193:36913)
0808 23:33:03.264224 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:03.264234 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:03.265083 (+ 849us) server_negotiation.cc:407] Connection header received
0808 23:33:03.265381 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:03.265387 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:03.265472 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:03.265586 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:03.266267 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.267080 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.268553 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.269133 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.269272 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:03.269793 (+ 521us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:03.269926 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:03.270024 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:03.270173 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 23:33:03.270262 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487}
I20260808 23:33:03.270756 29868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:03.263511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:36913 (local address 127.26.207.194:53509)
0808 23:33:03.264936 (+ 1425us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:03.264954 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:03.265219 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:03.265602 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:03.265607 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:03.265620 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 23:33:03.266047 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:03.266057 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.267234 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.267240 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:03.268383 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:03.268406 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.269340 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.269347 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:03.269494 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:03.269561 (+ 67us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 23:33:03.270028 (+ 467us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 23:33:03.270042 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 23:33:03.270146 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 23:33:03.270299 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1214,"thread_start_us":991,"threads_started":1}
I20260808 23:33:03.283754 29755 raft_consensus.cc:1261] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Refusing update from remote peer a09d2990e8af4696984a7e5ae4415212: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:03.284338 29463 raft_consensus.cc:1261] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e [term 1 FOLLOWER]: Refusing update from remote peer a09d2990e8af4696984a7e5ae4415212: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:03.285552 29829 consensus_queue.cc:1035] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:03.286257 29829 consensus_queue.cc:1035] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:03.344535 29847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:03.337177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:57293 (local address 127.26.207.194:36583)
0808 23:33:03.337374 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:03.337382 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:03.337535 (+ 153us) server_negotiation.cc:407] Connection header received
0808 23:33:03.337874 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:03.337880 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:03.337995 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:03.338095 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:03.338888 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.339827 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.342207 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.342896 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.343012 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:03.343753 (+ 741us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:03.343878 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:03.343962 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:03.344125 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 23:33:03.344198 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 23:33:03.344807 29874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:03.336512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:36583 (local address 127.26.207.193:57293)
0808 23:33:03.337417 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:03.337439 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:03.337685 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:03.338273 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:03.338278 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:03.338293 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 23:33:03.338711 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:03.338746 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.339973 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.339978 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:03.342006 (+ 2028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:03.342025 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.343238 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.343244 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:03.343435 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:03.343548 (+ 113us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 23:33:03.343997 (+ 449us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 23:33:03.344010 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 23:33:03.344112 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 23:33:03.344280 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":900,"threads_started":1}
I20260808 23:33:03.398586 29289 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:03.398948 29289 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:03.404513 29289 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d: Sending DeleteTablet for 3 replicas of tablet b7bf18a178564c97867b20c52fa4c718
I20260808 23:33:03.406071 29435 tablet_service.cc:1514] Processing DeleteTablet for tablet b7bf18a178564c97867b20c52fa4c718 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:03 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:57762
I20260808 23:33:03.407590 29729 tablet_service.cc:1514] Processing DeleteTablet for tablet b7bf18a178564c97867b20c52fa4c718 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:03 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:55164
I20260808 23:33:03.409601 29583 tablet_service.cc:1514] Processing DeleteTablet for tablet b7bf18a178564c97867b20c52fa4c718 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:03 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:42776
I20260808 23:33:03.413216 29288 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45744:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:33:03.414371 29288 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:33:03.425554 29879 tablet_replica.cc:330] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd: stopping tablet replica
I20260808 23:33:03.426384 29729 tablet_service.cc:1467] Processing CreateTablet for tablet 7bce7ace20054c78a08d6088751f86b0 (DEFAULT_TABLE table=test-table [id=3d821f030e0e4f7d9d3189d2e3d3307c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:03.426842 29434 tablet_service.cc:1467] Processing CreateTablet for tablet 7bce7ace20054c78a08d6088751f86b0 (DEFAULT_TABLE table=test-table [id=3d821f030e0e4f7d9d3189d2e3d3307c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:03.426944 29582 tablet_service.cc:1467] Processing CreateTablet for tablet 7bce7ace20054c78a08d6088751f86b0 (DEFAULT_TABLE table=test-table [id=3d821f030e0e4f7d9d3189d2e3d3307c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:03.427330 29729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bce7ace20054c78a08d6088751f86b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:03.427501 29434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bce7ace20054c78a08d6088751f86b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:03.428257 29582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bce7ace20054c78a08d6088751f86b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:03.436002 29879 raft_consensus.cc:2229] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:03.437140 29879 raft_consensus.cc:2258] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:03.439991 29879 ts_tablet_manager.cc:1905] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:03.440970 29880 tablet_replica.cc:330] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212: stopping tablet replica
I20260808 23:33:03.441715 29880 raft_consensus.cc:2229] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:33:03.442987 29880 raft_consensus.cc:2258] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:03.445082 29824 tablet_bootstrap.cc:492] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e: Bootstrap starting.
I20260808 23:33:03.446029 29878 tablet_replica.cc:330] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e: stopping tablet replica
I20260808 23:33:03.449350 29880 ts_tablet_manager.cc:1905] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:03.447301 29824 tablet_bootstrap.cc:654] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:03.456205 29878 raft_consensus.cc:2229] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:03.461228 29827 tablet_bootstrap.cc:492] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd: Bootstrap starting.
I20260808 23:33:03.463819 29827 tablet_bootstrap.cc:654] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:03.470016 29827 tablet_bootstrap.cc:492] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd: No bootstrap required, opened a new log
I20260808 23:33:03.470330 29827 ts_tablet_manager.cc:1397] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.001s
I20260808 23:33:03.471292 29827 raft_consensus.cc:348] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.471750 29827 raft_consensus.cc:374] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:03.471988 29827 raft_consensus.cc:729] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b782467b568048c7ace5c67f7a7a8efd, State: Initialized, Role: FOLLOWER
I20260808 23:33:03.472474 29827 consensus_queue.cc:260] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.476495 29827 ts_tablet_manager.cc:1428] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260808 23:33:03.480791 29878 raft_consensus.cc:2258] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:03.456272 29823 tablet_bootstrap.cc:492] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212: Bootstrap starting.
I20260808 23:33:03.483408 29823 tablet_bootstrap.cc:654] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:03.492166 29823 tablet_bootstrap.cc:492] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212: No bootstrap required, opened a new log
I20260808 23:33:03.492460 29823 ts_tablet_manager.cc:1397] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.001s
I20260808 23:33:03.493777 29823 raft_consensus.cc:348] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.494136 29823 raft_consensus.cc:374] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:03.494243 29823 raft_consensus.cc:729] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09d2990e8af4696984a7e5ae4415212, State: Initialized, Role: FOLLOWER
I20260808 23:33:03.494692 29823 consensus_queue.cc:260] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.495458 29823 ts_tablet_manager.cc:1428] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260808 23:33:03.500129 29878 ts_tablet_manager.cc:1905] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:03.504281 29880 ts_tablet_manager.cc:1918] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 23:33:03.504536 29880 log.cc:1196] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/b7bf18a178564c97867b20c52fa4c718
I20260808 23:33:03.506211 29824 tablet_bootstrap.cc:492] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e: No bootstrap required, opened a new log
I20260808 23:33:03.506482 29824 ts_tablet_manager.cc:1397] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e: Time spent bootstrapping tablet: real 0.061s user 0.005s sys 0.008s
I20260808 23:33:03.507385 29824 raft_consensus.cc:348] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.507687 29824 raft_consensus.cc:374] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:03.507779 29824 raft_consensus.cc:729] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39850fc924294e83a6161a5f80efe85e, State: Initialized, Role: FOLLOWER
I20260808 23:33:03.508695 29880 ts_tablet_manager.cc:1939] T b7bf18a178564c97867b20c52fa4c718 P a09d2990e8af4696984a7e5ae4415212: Deleting consensus metadata
I20260808 23:33:03.508904 29824 consensus_queue.cc:260] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.509657 29824 ts_tablet_manager.cc:1428] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 23:33:03.511895 29879 ts_tablet_manager.cc:1918] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 23:33:03.512110 29879 log.cc:1196] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/b7bf18a178564c97867b20c52fa4c718
I20260808 23:33:03.512696 29879 ts_tablet_manager.cc:1939] T b7bf18a178564c97867b20c52fa4c718 P b782467b568048c7ace5c67f7a7a8efd: Deleting consensus metadata
I20260808 23:33:03.514850 29275 catalog_manager.cc:4841] TS b782467b568048c7ace5c67f7a7a8efd (127.26.207.195:37601): tablet b7bf18a178564c97867b20c52fa4c718 (table test-table [id=ca63d64f9be9492fb54d11a2a1b5c9f3]) successfully deleted
I20260808 23:33:03.515202 29277 catalog_manager.cc:4841] TS a09d2990e8af4696984a7e5ae4415212 (127.26.207.194:36583): tablet b7bf18a178564c97867b20c52fa4c718 (table test-table [id=ca63d64f9be9492fb54d11a2a1b5c9f3]) successfully deleted
I20260808 23:33:03.516886 29878 ts_tablet_manager.cc:1918] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 23:33:03.517119 29878 log.cc:1196] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/b7bf18a178564c97867b20c52fa4c718
I20260808 23:33:03.518033 29878 ts_tablet_manager.cc:1939] T b7bf18a178564c97867b20c52fa4c718 P 39850fc924294e83a6161a5f80efe85e: Deleting consensus metadata
I20260808 23:33:03.520440 29275 catalog_manager.cc:4841] TS 39850fc924294e83a6161a5f80efe85e (127.26.207.193:36913): tablet b7bf18a178564c97867b20c52fa4c718 (table test-table [id=ca63d64f9be9492fb54d11a2a1b5c9f3]) successfully deleted
I20260808 23:33:03.665052 29862 raft_consensus.cc:482] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:33:03.665342 29862 raft_consensus.cc:504] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.666343 29862 leader_election.cc:288] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09d2990e8af4696984a7e5ae4415212 (127.26.207.194:36583), b782467b568048c7ace5c67f7a7a8efd (127.26.207.195:37601)
I20260808 23:33:03.667007 29606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bce7ace20054c78a08d6088751f86b0" candidate_uuid: "39850fc924294e83a6161a5f80efe85e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09d2990e8af4696984a7e5ae4415212" is_pre_election: true
I20260808 23:33:03.667292 29606 raft_consensus.cc:2454] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39850fc924294e83a6161a5f80efe85e in term 0.
I20260808 23:33:03.667227 29754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bce7ace20054c78a08d6088751f86b0" candidate_uuid: "39850fc924294e83a6161a5f80efe85e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b782467b568048c7ace5c67f7a7a8efd" is_pre_election: true
I20260808 23:33:03.667505 29754 raft_consensus.cc:2454] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39850fc924294e83a6161a5f80efe85e in term 0.
I20260808 23:33:03.668124 29384 leader_election.cc:302] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39850fc924294e83a6161a5f80efe85e, a09d2990e8af4696984a7e5ae4415212; no voters:
I20260808 23:33:03.668689 29862 raft_consensus.cc:2781] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:33:03.668880 29862 raft_consensus.cc:482] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:33:03.668995 29862 raft_consensus.cc:3037] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:03.673357 29862 raft_consensus.cc:504] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.674818 29754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bce7ace20054c78a08d6088751f86b0" candidate_uuid: "39850fc924294e83a6161a5f80efe85e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b782467b568048c7ace5c67f7a7a8efd"
I20260808 23:33:03.674832 29606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bce7ace20054c78a08d6088751f86b0" candidate_uuid: "39850fc924294e83a6161a5f80efe85e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09d2990e8af4696984a7e5ae4415212"
I20260808 23:33:03.675078 29754 raft_consensus.cc:3037] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:03.675091 29606 raft_consensus.cc:3037] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:03.678414 29754 raft_consensus.cc:2454] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39850fc924294e83a6161a5f80efe85e in term 1.
I20260808 23:33:03.679060 29382 leader_election.cc:302] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39850fc924294e83a6161a5f80efe85e, b782467b568048c7ace5c67f7a7a8efd; no voters:
I20260808 23:33:03.679064 29606 raft_consensus.cc:2454] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39850fc924294e83a6161a5f80efe85e in term 1.
I20260808 23:33:03.679549 29869 raft_consensus.cc:2781] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:03.679751 29862 leader_election.cc:288] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [CANDIDATE]: Term 1 election: Requested vote from peers a09d2990e8af4696984a7e5ae4415212 (127.26.207.194:36583), b782467b568048c7ace5c67f7a7a8efd (127.26.207.195:37601)
I20260808 23:33:03.679843 29869 raft_consensus.cc:686] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [term 1 LEADER]: Becoming Leader. State: Replica: 39850fc924294e83a6161a5f80efe85e, State: Running, Role: LEADER
I20260808 23:33:03.680399 29869 consensus_queue.cc:237] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:03.684736 29288 catalog_manager.cc:5495] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e reported cstate change: term changed from 0 to 1, leader changed from <none> to 39850fc924294e83a6161a5f80efe85e (127.26.207.193). New cstate: current_term: 1 leader_uuid: "39850fc924294e83a6161a5f80efe85e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } health_report { overall_health: UNKNOWN } } }
I20260808 23:33:03.766957 29817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:03.758189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57788 (local address 127.26.207.193:36913)
0808 23:33:03.758428 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:03.758435 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:03.761473 (+ 3038us) server_negotiation.cc:407] Connection header received
0808 23:33:03.761696 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:03.761702 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:03.761788 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:03.761889 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:03.762392 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.763194 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.764668 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.765391 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.765542 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:03.766073 (+ 531us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:03.766227 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:03.766328 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:03.766516 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 23:33:03.766625 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 23:33:03.782977 29817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:03.776654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:44851 (local address 127.26.207.193:36913)
0808 23:33:03.776969 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:03.776977 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:03.777399 (+ 422us) server_negotiation.cc:407] Connection header received
0808 23:33:03.777447 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:03.777450 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:03.777501 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:03.777590 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:03.778054 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.778809 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.780707 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.781278 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.781440 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:03.781962 (+ 522us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:03.782166 (+ 204us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:03.782265 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:03.782470 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 23:33:03.782554 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":73,"server-negotiator.queue_time_us":69}
I20260808 23:33:03.782977 29874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:03.776871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:36913 (local address 127.26.207.193:44851)
0808 23:33:03.777125 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:03.777159 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:03.777313 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:03.777604 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:03.777608 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:03.777619 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 23:33:03.777887 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:03.777898 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.778953 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.778959 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:03.780546 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:03.780563 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:03.781452 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:03.781458 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:03.781747 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:03.781789 (+ 42us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 23:33:03.782266 (+ 477us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 23:33:03.782279 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 23:33:03.782449 (+ 170us) client_negotiation.cc:240] Negotiation successful
0808 23:33:03.782617 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":25}
I20260808 23:33:03.793334 29754 raft_consensus.cc:1261] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Refusing update from remote peer 39850fc924294e83a6161a5f80efe85e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:03.794121 29606 raft_consensus.cc:1261] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Refusing update from remote peer 39850fc924294e83a6161a5f80efe85e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:03.794749 29862 consensus_queue.cc:1035] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:03.795284 29862 consensus_queue.cc:1035] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 23:33:03.826390 29855 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 23:33:05.483250 29288 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:05.483595 29288 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:05.488677 29288 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d: Sending DeleteTablet for 3 replicas of tablet 7bce7ace20054c78a08d6088751f86b0
I20260808 23:33:05.489812 29435 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bce7ace20054c78a08d6088751f86b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:05 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:57762
I20260808 23:33:05.489933 29729 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bce7ace20054c78a08d6088751f86b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:05 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:55164
I20260808 23:33:05.490134 29582 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bce7ace20054c78a08d6088751f86b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:05 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:42776
I20260808 23:33:05.503151 29915 tablet_replica.cc:330] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212: stopping tablet replica
I20260808 23:33:05.503705 29915 raft_consensus.cc:2229] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:05.504124 29915 raft_consensus.cc:2258] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:05.505246 29913 tablet_replica.cc:330] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e: stopping tablet replica
I20260808 23:33:05.505481 29913 raft_consensus.cc:2229] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:33:05.505831 29915 ts_tablet_manager.cc:1905] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:05.506368 29913 raft_consensus.cc:2258] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:05.507582 29913 ts_tablet_manager.cc:1905] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:05.510619 29914 tablet_replica.cc:330] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd: stopping tablet replica
I20260808 23:33:05.511041 29914 raft_consensus.cc:2229] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:05.511406 29914 raft_consensus.cc:2258] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:05.512652 29914 ts_tablet_manager.cc:1905] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:05.514833 29915 ts_tablet_manager.cc:1918] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 23:33:05.515079 29915 log.cc:1196] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/7bce7ace20054c78a08d6088751f86b0
I20260808 23:33:05.515739 29915 ts_tablet_manager.cc:1939] T 7bce7ace20054c78a08d6088751f86b0 P a09d2990e8af4696984a7e5ae4415212: Deleting consensus metadata
I20260808 23:33:05.515941 29913 ts_tablet_manager.cc:1918] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 23:33:05.516158 29913 log.cc:1196] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/7bce7ace20054c78a08d6088751f86b0
I20260808 23:33:05.516736 29913 ts_tablet_manager.cc:1939] T 7bce7ace20054c78a08d6088751f86b0 P 39850fc924294e83a6161a5f80efe85e: Deleting consensus metadata
I20260808 23:33:05.517300 29277 catalog_manager.cc:4841] TS a09d2990e8af4696984a7e5ae4415212 (127.26.207.194:36583): tablet 7bce7ace20054c78a08d6088751f86b0 (table test-table [id=3d821f030e0e4f7d9d3189d2e3d3307c]) successfully deleted
I20260808 23:33:05.517930 29275 catalog_manager.cc:4841] TS 39850fc924294e83a6161a5f80efe85e (127.26.207.193:36913): tablet 7bce7ace20054c78a08d6088751f86b0 (table test-table [id=3d821f030e0e4f7d9d3189d2e3d3307c]) successfully deleted
I20260808 23:33:05.521298 29914 ts_tablet_manager.cc:1918] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 23:33:05.521543 29914 log.cc:1196] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/7bce7ace20054c78a08d6088751f86b0
I20260808 23:33:05.522257 29914 ts_tablet_manager.cc:1939] T 7bce7ace20054c78a08d6088751f86b0 P b782467b568048c7ace5c67f7a7a8efd: Deleting consensus metadata
I20260808 23:33:05.523574 29275 catalog_manager.cc:4841] TS b782467b568048c7ace5c67f7a7a8efd (127.26.207.195:37601): tablet 7bce7ace20054c78a08d6088751f86b0 (table test-table [id=3d821f030e0e4f7d9d3189d2e3d3307c]) successfully deleted
Aug 08 23:33:05 dist-test-slave-1x4g krb5kdc[29243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231985, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 23:33:05 dist-test-slave-1x4g krb5kdc[29243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231985, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:05.571091 29924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:05.552633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45770 (local address 127.26.207.254:40521)
0808 23:33:05.553531 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:05.553538 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:05.553580 (+ 42us) server_negotiation.cc:407] Connection header received
0808 23:33:05.553829 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:05.553834 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:05.553906 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:05.554030 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:05.555919 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:05.557067 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:05.558633 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:05.559114 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:05.559236 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:05.564299 (+ 5063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:05.564307 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:05.564311 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:05.564372 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:05.567617 (+ 3245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:05.568572 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:05.568579 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:05.568582 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:05.568748 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:05.569276 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:05.569281 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:05.569285 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:05.569605 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:05.569863 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:05.570323 (+ 460us) server_negotiation.cc:299] Negotiation successful
0808 23:33:05.570624 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":715,"thread_start_us":441,"threads_started":1}
I20260808 23:33:05.575677 29288 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45770:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:33:05.576396 29288 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:33:05.584254 29582 tablet_service.cc:1467] Processing CreateTablet for tablet a6d2aecc17c74d328d92c02e2d64b5c9 (DEFAULT_TABLE table=test-table [id=e990da0be95f4ff3b7bd511af5a2eb38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:05.584290 29435 tablet_service.cc:1467] Processing CreateTablet for tablet a6d2aecc17c74d328d92c02e2d64b5c9 (DEFAULT_TABLE table=test-table [id=e990da0be95f4ff3b7bd511af5a2eb38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:05.584769 29435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6d2aecc17c74d328d92c02e2d64b5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:05.584839 29582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6d2aecc17c74d328d92c02e2d64b5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:05.585017 29729 tablet_service.cc:1467] Processing CreateTablet for tablet a6d2aecc17c74d328d92c02e2d64b5c9 (DEFAULT_TABLE table=test-table [id=e990da0be95f4ff3b7bd511af5a2eb38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:05.585489 29729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6d2aecc17c74d328d92c02e2d64b5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:05.592270 29925 tablet_bootstrap.cc:492] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd: Bootstrap starting.
I20260808 23:33:05.593164 29927 tablet_bootstrap.cc:492] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212: Bootstrap starting.
I20260808 23:33:05.594118 29926 tablet_bootstrap.cc:492] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e: Bootstrap starting.
I20260808 23:33:05.594929 29925 tablet_bootstrap.cc:654] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:05.596684 29926 tablet_bootstrap.cc:654] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:05.597518 29925 tablet_bootstrap.cc:492] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd: No bootstrap required, opened a new log
I20260808 23:33:05.597710 29925 ts_tablet_manager.cc:1397] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 23:33:05.598146 29927 tablet_bootstrap.cc:654] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:05.598542 29925 raft_consensus.cc:348] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.598855 29925 raft_consensus.cc:374] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:05.598954 29925 raft_consensus.cc:729] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b782467b568048c7ace5c67f7a7a8efd, State: Initialized, Role: FOLLOWER
I20260808 23:33:05.599269 29925 consensus_queue.cc:260] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.601100 29925 ts_tablet_manager.cc:1428] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 23:33:05.606151 29927 tablet_bootstrap.cc:492] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212: No bootstrap required, opened a new log
I20260808 23:33:05.606163 29926 tablet_bootstrap.cc:492] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e: No bootstrap required, opened a new log
I20260808 23:33:05.606343 29927 ts_tablet_manager.cc:1397] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.003s
I20260808 23:33:05.606357 29926 ts_tablet_manager.cc:1397] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260808 23:33:05.607152 29927 raft_consensus.cc:348] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.607218 29926 raft_consensus.cc:348] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.607390 29927 raft_consensus.cc:374] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:05.607481 29926 raft_consensus.cc:374] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:05.607579 29927 raft_consensus.cc:729] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09d2990e8af4696984a7e5ae4415212, State: Initialized, Role: FOLLOWER
I20260808 23:33:05.607616 29926 raft_consensus.cc:729] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39850fc924294e83a6161a5f80efe85e, State: Initialized, Role: FOLLOWER
I20260808 23:33:05.607892 29926 consensus_queue.cc:260] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.607944 29927 consensus_queue.cc:260] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.608603 29926 ts_tablet_manager.cc:1428] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260808 23:33:05.608965 29927 ts_tablet_manager.cc:1428] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260808 23:33:05.683391 29894 raft_consensus.cc:482] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:33:05.683629 29894 raft_consensus.cc:504] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.684382 29894 leader_election.cc:288] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09d2990e8af4696984a7e5ae4415212 (127.26.207.194:36583), b782467b568048c7ace5c67f7a7a8efd (127.26.207.195:37601)
I20260808 23:33:05.684999 29606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6d2aecc17c74d328d92c02e2d64b5c9" candidate_uuid: "39850fc924294e83a6161a5f80efe85e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09d2990e8af4696984a7e5ae4415212" is_pre_election: true
I20260808 23:33:05.685096 29754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6d2aecc17c74d328d92c02e2d64b5c9" candidate_uuid: "39850fc924294e83a6161a5f80efe85e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b782467b568048c7ace5c67f7a7a8efd" is_pre_election: true
I20260808 23:33:05.685281 29606 raft_consensus.cc:2454] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39850fc924294e83a6161a5f80efe85e in term 0.
I20260808 23:33:05.685407 29754 raft_consensus.cc:2454] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39850fc924294e83a6161a5f80efe85e in term 0.
I20260808 23:33:05.685878 29384 leader_election.cc:302] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39850fc924294e83a6161a5f80efe85e, a09d2990e8af4696984a7e5ae4415212; no voters:
I20260808 23:33:05.686231 29894 raft_consensus.cc:2781] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:33:05.686404 29894 raft_consensus.cc:482] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:33:05.686539 29894 raft_consensus.cc:3037] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:05.688879 29894 raft_consensus.cc:504] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.689630 29894 leader_election.cc:288] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [CANDIDATE]: Term 1 election: Requested vote from peers a09d2990e8af4696984a7e5ae4415212 (127.26.207.194:36583), b782467b568048c7ace5c67f7a7a8efd (127.26.207.195:37601)
I20260808 23:33:05.690213 29754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6d2aecc17c74d328d92c02e2d64b5c9" candidate_uuid: "39850fc924294e83a6161a5f80efe85e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b782467b568048c7ace5c67f7a7a8efd"
I20260808 23:33:05.690245 29606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6d2aecc17c74d328d92c02e2d64b5c9" candidate_uuid: "39850fc924294e83a6161a5f80efe85e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09d2990e8af4696984a7e5ae4415212"
I20260808 23:33:05.690501 29606 raft_consensus.cc:3037] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:05.690608 29754 raft_consensus.cc:3037] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:05.692915 29606 raft_consensus.cc:2454] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39850fc924294e83a6161a5f80efe85e in term 1.
I20260808 23:33:05.692902 29754 raft_consensus.cc:2454] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39850fc924294e83a6161a5f80efe85e in term 1.
I20260808 23:33:05.693476 29382 leader_election.cc:302] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39850fc924294e83a6161a5f80efe85e, b782467b568048c7ace5c67f7a7a8efd; no voters:
I20260808 23:33:05.694087 29894 raft_consensus.cc:2781] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:05.694284 29894 raft_consensus.cc:686] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [term 1 LEADER]: Becoming Leader. State: Replica: 39850fc924294e83a6161a5f80efe85e, State: Running, Role: LEADER
I20260808 23:33:05.694633 29894 consensus_queue.cc:237] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.697921 29290 catalog_manager.cc:5495] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e reported cstate change: term changed from 0 to 1, leader changed from <none> to 39850fc924294e83a6161a5f80efe85e (127.26.207.193). New cstate: current_term: 1 leader_uuid: "39850fc924294e83a6161a5f80efe85e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } health_report { overall_health: UNKNOWN } } }
I20260808 23:33:05.737201 29937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:05.730406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57800 (local address 127.26.207.193:36913)
0808 23:33:05.731115 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:05.731119 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:05.731142 (+ 23us) server_negotiation.cc:407] Connection header received
0808 23:33:05.731208 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:05.731211 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:05.731283 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:05.731377 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:05.731866 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:05.732767 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:05.734425 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:05.735210 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:05.735354 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:05.736015 (+ 661us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:05.736158 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:05.736244 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:05.736595 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 23:33:05.736719 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":343,"threads_started":1}
I20260808 23:33:05.747795 29606 raft_consensus.cc:1261] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Refusing update from remote peer 39850fc924294e83a6161a5f80efe85e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:05.748433 29754 raft_consensus.cc:1261] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Refusing update from remote peer 39850fc924294e83a6161a5f80efe85e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:05.748714 29894 consensus_queue.cc:1035] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:05.749222 29908 consensus_queue.cc:1035] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:05.758922 29897 mvcc.cc:205] Tried to move back new op lower bound from 7316406213616480256 to 7316406213407870976. Current Snapshot: MvccSnapshot[applied={T|T < 7316406213616480256}]
I20260808 23:33:05.806272 29290 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:05.806640 29290 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:05.810410 29290 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d: Sending DeleteTablet for 3 replicas of tablet a6d2aecc17c74d328d92c02e2d64b5c9
I20260808 23:33:05.811641 29729 tablet_service.cc:1514] Processing DeleteTablet for tablet a6d2aecc17c74d328d92c02e2d64b5c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:05 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:55164
I20260808 23:33:05.811619 29582 tablet_service.cc:1514] Processing DeleteTablet for tablet a6d2aecc17c74d328d92c02e2d64b5c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:05 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:42776
I20260808 23:33:05.811685 29434 tablet_service.cc:1514] Processing DeleteTablet for tablet a6d2aecc17c74d328d92c02e2d64b5c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:05 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:57762
I20260808 23:33:05.811990 29914 tablet_replica.cc:330] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd: stopping tablet replica
I20260808 23:33:05.812050 29915 tablet_replica.cc:330] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212: stopping tablet replica
I20260808 23:33:05.812228 29914 raft_consensus.cc:2229] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:05.812310 29913 tablet_replica.cc:330] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e: stopping tablet replica
I20260808 23:33:05.812326 29915 raft_consensus.cc:2229] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:05.812522 29914 raft_consensus.cc:2258] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:05.812606 29915 raft_consensus.cc:2258] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:05.812633 29913 raft_consensus.cc:2229] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:33:05.813099 29913 raft_consensus.cc:2258] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:05.813130 29290 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45770:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 23:33:05.814069 29915 ts_tablet_manager.cc:1905] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:05.814313 29914 ts_tablet_manager.cc:1905] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:05.814404 29913 ts_tablet_manager.cc:1905] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 23:33:05.814843 29290 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:33:05.822651 29914 ts_tablet_manager.cc:1918] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 23:33:05.822685 29915 ts_tablet_manager.cc:1918] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 23:33:05.822979 29915 log.cc:1196] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/a6d2aecc17c74d328d92c02e2d64b5c9
I20260808 23:33:05.823014 29914 log.cc:1196] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/a6d2aecc17c74d328d92c02e2d64b5c9
I20260808 23:33:05.823643 29913 ts_tablet_manager.cc:1918] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 23:33:05.823722 29915 ts_tablet_manager.cc:1939] T a6d2aecc17c74d328d92c02e2d64b5c9 P a09d2990e8af4696984a7e5ae4415212: Deleting consensus metadata
I20260808 23:33:05.823704 29914 ts_tablet_manager.cc:1939] T a6d2aecc17c74d328d92c02e2d64b5c9 P b782467b568048c7ace5c67f7a7a8efd: Deleting consensus metadata
I20260808 23:33:05.824023 29913 log.cc:1196] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/a6d2aecc17c74d328d92c02e2d64b5c9
I20260808 23:33:05.825022 29277 catalog_manager.cc:4841] TS a09d2990e8af4696984a7e5ae4415212 (127.26.207.194:36583): tablet a6d2aecc17c74d328d92c02e2d64b5c9 (table test-table [id=e990da0be95f4ff3b7bd511af5a2eb38]) successfully deleted
I20260808 23:33:05.825155 29434 tablet_service.cc:1467] Processing CreateTablet for tablet 25f831457a574be38fc78e1623bd3e08 (DEFAULT_TABLE table=test-table [id=6acaba70fa4949a38d926ad0d6390f5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:05.825173 29729 tablet_service.cc:1467] Processing CreateTablet for tablet 25f831457a574be38fc78e1623bd3e08 (DEFAULT_TABLE table=test-table [id=6acaba70fa4949a38d926ad0d6390f5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:05.825553 29582 tablet_service.cc:1467] Processing CreateTablet for tablet 25f831457a574be38fc78e1623bd3e08 (DEFAULT_TABLE table=test-table [id=6acaba70fa4949a38d926ad0d6390f5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:05.825736 29434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25f831457a574be38fc78e1623bd3e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:05.825762 29729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25f831457a574be38fc78e1623bd3e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:05.826154 29582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25f831457a574be38fc78e1623bd3e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:05.828594 29275 catalog_manager.cc:4841] TS b782467b568048c7ace5c67f7a7a8efd (127.26.207.195:37601): tablet a6d2aecc17c74d328d92c02e2d64b5c9 (table test-table [id=e990da0be95f4ff3b7bd511af5a2eb38]) successfully deleted
I20260808 23:33:05.830474 29913 ts_tablet_manager.cc:1939] T a6d2aecc17c74d328d92c02e2d64b5c9 P 39850fc924294e83a6161a5f80efe85e: Deleting consensus metadata
I20260808 23:33:05.832111 29275 catalog_manager.cc:4841] TS 39850fc924294e83a6161a5f80efe85e (127.26.207.193:36913): tablet a6d2aecc17c74d328d92c02e2d64b5c9 (table test-table [id=e990da0be95f4ff3b7bd511af5a2eb38]) successfully deleted
I20260808 23:33:05.833977 29925 tablet_bootstrap.cc:492] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd: Bootstrap starting.
I20260808 23:33:05.834309 29927 tablet_bootstrap.cc:492] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212: Bootstrap starting.
I20260808 23:33:05.835004 29926 tablet_bootstrap.cc:492] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e: Bootstrap starting.
I20260808 23:33:05.836532 29927 tablet_bootstrap.cc:654] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:05.836524 29925 tablet_bootstrap.cc:654] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:05.837013 29926 tablet_bootstrap.cc:654] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:05.839592 29925 tablet_bootstrap.cc:492] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd: No bootstrap required, opened a new log
I20260808 23:33:05.839946 29927 tablet_bootstrap.cc:492] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212: No bootstrap required, opened a new log
I20260808 23:33:05.839943 29925 ts_tablet_manager.cc:1397] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20260808 23:33:05.840255 29927 ts_tablet_manager.cc:1397] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260808 23:33:05.841166 29925 raft_consensus.cc:348] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.841650 29925 raft_consensus.cc:374] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:05.841511 29927 raft_consensus.cc:348] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.841787 29925 raft_consensus.cc:729] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b782467b568048c7ace5c67f7a7a8efd, State: Initialized, Role: FOLLOWER
I20260808 23:33:05.841830 29926 tablet_bootstrap.cc:492] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e: No bootstrap required, opened a new log
I20260808 23:33:05.841910 29927 raft_consensus.cc:374] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:05.842016 29927 raft_consensus.cc:729] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09d2990e8af4696984a7e5ae4415212, State: Initialized, Role: FOLLOWER
I20260808 23:33:05.842164 29926 ts_tablet_manager.cc:1397] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260808 23:33:05.842166 29925 consensus_queue.cc:260] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.842433 29927 consensus_queue.cc:260] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.842896 29925 ts_tablet_manager.cc:1428] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260808 23:33:05.843483 29926 raft_consensus.cc:348] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.843811 29926 raft_consensus.cc:374] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:05.843952 29926 raft_consensus.cc:729] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39850fc924294e83a6161a5f80efe85e, State: Initialized, Role: FOLLOWER
I20260808 23:33:05.844130 29927 ts_tablet_manager.cc:1428] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260808 23:33:05.844309 29926 consensus_queue.cc:260] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.844941 29926 ts_tablet_manager.cc:1428] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260808 23:33:05.974853 29931 raft_consensus.cc:482] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:33:05.975171 29931 raft_consensus.cc:504] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.977238 29931 leader_election.cc:288] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39850fc924294e83a6161a5f80efe85e (127.26.207.193:36913), a09d2990e8af4696984a7e5ae4415212 (127.26.207.194:36583)
I20260808 23:33:05.986042 29937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:05.978020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:46953 (local address 127.26.207.193:36913)
0808 23:33:05.978412 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:05.978429 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:05.979565 (+ 1136us) server_negotiation.cc:407] Connection header received
0808 23:33:05.979766 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:05.979771 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:05.979855 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:05.979970 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:05.980626 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:05.981687 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:05.983908 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:05.984936 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:05.985133 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:05.985214 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:05.985560 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 23:33:05.985708 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234}
I20260808 23:33:05.986104 29945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:05.977754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:52205 (local address 127.26.207.194:36583)
0808 23:33:05.978982 (+ 1228us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:05.978991 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:05.979026 (+ 35us) server_negotiation.cc:407] Connection header received
0808 23:33:05.979120 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:05.979125 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:05.979206 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:05.979475 (+ 269us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:05.980223 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:05.981361 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:05.983906 (+ 2545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:05.984874 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:05.985107 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:05.985204 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:05.985544 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 23:33:05.985702 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1061,"thread_start_us":905,"threads_started":1}
I20260808 23:33:05.986375 29944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:05.977553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:36583 (local address 127.26.207.195:52205)
0808 23:33:05.978698 (+ 1145us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:05.978725 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:05.978942 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:05.979480 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:05.979483 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:05.979528 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:05.979985 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:05.980000 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:05.981560 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:05.981565 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:05.983695 (+ 2130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:05.983712 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:05.985113 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:05.985121 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:05.985325 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:05.985380 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 23:33:05.985489 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 23:33:05.985671 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":975,"mutex_wait_us":47,"thread_start_us":739,"threads_started":1}
I20260808 23:33:05.986480 29946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:05.977833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:36913 (local address 127.26.207.195:46953)
0808 23:33:05.979301 (+ 1468us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:05.979328 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:05.979607 (+ 279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:05.979990 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:05.979993 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:05.980013 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:05.980457 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:05.980470 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:05.981832 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:05.981839 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:05.983708 (+ 1869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:05.983723 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:05.985183 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:05.985189 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:05.985367 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:05.985393 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 23:33:05.985508 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 23:33:05.985696 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1312,"mutex_wait_us":52,"thread_start_us":1082,"threads_started":1}
I20260808 23:33:05.987277 29606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25f831457a574be38fc78e1623bd3e08" candidate_uuid: "b782467b568048c7ace5c67f7a7a8efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09d2990e8af4696984a7e5ae4415212" is_pre_election: true
I20260808 23:33:05.987504 29606 raft_consensus.cc:2454] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b782467b568048c7ace5c67f7a7a8efd in term 0.
I20260808 23:33:05.987598 29463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25f831457a574be38fc78e1623bd3e08" candidate_uuid: "b782467b568048c7ace5c67f7a7a8efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39850fc924294e83a6161a5f80efe85e" is_pre_election: true
I20260808 23:33:05.987890 29463 raft_consensus.cc:2454] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b782467b568048c7ace5c67f7a7a8efd in term 0.
I20260808 23:33:05.988057 29681 leader_election.cc:302] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a09d2990e8af4696984a7e5ae4415212, b782467b568048c7ace5c67f7a7a8efd; no voters:
I20260808 23:33:05.988516 29931 raft_consensus.cc:2781] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:33:05.988628 29931 raft_consensus.cc:482] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:33:05.988691 29931 raft_consensus.cc:3037] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:05.991552 29931 raft_consensus.cc:504] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:05.992326 29931 leader_election.cc:288] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [CANDIDATE]: Term 1 election: Requested vote from peers 39850fc924294e83a6161a5f80efe85e (127.26.207.193:36913), a09d2990e8af4696984a7e5ae4415212 (127.26.207.194:36583)
I20260808 23:33:05.992873 29463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25f831457a574be38fc78e1623bd3e08" candidate_uuid: "b782467b568048c7ace5c67f7a7a8efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39850fc924294e83a6161a5f80efe85e"
I20260808 23:33:05.993012 29606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25f831457a574be38fc78e1623bd3e08" candidate_uuid: "b782467b568048c7ace5c67f7a7a8efd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09d2990e8af4696984a7e5ae4415212"
I20260808 23:33:05.993163 29463 raft_consensus.cc:3037] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:05.993271 29606 raft_consensus.cc:3037] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:05.996652 29463 raft_consensus.cc:2454] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b782467b568048c7ace5c67f7a7a8efd in term 1.
I20260808 23:33:05.996662 29606 raft_consensus.cc:2454] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b782467b568048c7ace5c67f7a7a8efd in term 1.
I20260808 23:33:05.997460 29679 leader_election.cc:302] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 39850fc924294e83a6161a5f80efe85e, a09d2990e8af4696984a7e5ae4415212, b782467b568048c7ace5c67f7a7a8efd; no voters:
I20260808 23:33:05.997983 29931 raft_consensus.cc:2781] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:05.998648 29931 raft_consensus.cc:686] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [term 1 LEADER]: Becoming Leader. State: Replica: b782467b568048c7ace5c67f7a7a8efd, State: Running, Role: LEADER
I20260808 23:33:05.999115 29931 consensus_queue.cc:237] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } }
I20260808 23:33:06.003446 29288 catalog_manager.cc:5495] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd reported cstate change: term changed from 0 to 1, leader changed from <none> to b782467b568048c7ace5c67f7a7a8efd (127.26.207.195). New cstate: current_term: 1 leader_uuid: "b782467b568048c7ace5c67f7a7a8efd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b782467b568048c7ace5c67f7a7a8efd" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37601 } health_report { overall_health: HEALTHY } } }
I20260808 23:33:06.051942 29949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:06.043649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55172 (local address 127.26.207.195:37601)
0808 23:33:06.044491 (+ 842us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:06.044496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:06.044516 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:33:06.044607 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:06.044610 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:06.044690 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:06.045029 (+ 339us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:06.045713 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:06.046814 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:06.048507 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:06.049315 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:06.049485 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:06.050249 (+ 764us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:06.051005 (+ 756us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:06.051180 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:06.051299 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 23:33:06.051398 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":512,"threads_started":1}
I20260808 23:33:06.076462 29937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:06.067428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:52553 (local address 127.26.207.193:36913)
0808 23:33:06.067685 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:06.067692 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:06.069240 (+ 1548us) server_negotiation.cc:407] Connection header received
0808 23:33:06.069450 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:06.069455 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:06.069554 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:06.069649 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:06.070388 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:06.071554 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:06.074114 (+ 2560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:06.074738 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:06.074872 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:06.075626 (+ 754us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:06.075759 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:06.075836 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:06.075978 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 23:33:06.076124 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 23:33:06.076848 29952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:06.067694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:36913 (local address 127.26.207.195:52553)
0808 23:33:06.069045 (+ 1351us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:06.069080 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:06.069287 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:06.069680 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:06.069683 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:06.069694 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 23:33:06.070191 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:06.070201 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:06.071759 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:06.071768 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:06.073907 (+ 2139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:06.073927 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:06.075005 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:06.075011 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:06.075291 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:06.075369 (+ 78us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 23:33:06.075854 (+ 485us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 23:33:06.075864 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 23:33:06.075927 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 23:33:06.076052 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1136,"thread_start_us":820,"threads_started":1}
I20260808 23:33:06.087242 29606 raft_consensus.cc:1261] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Refusing update from remote peer b782467b568048c7ace5c67f7a7a8efd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:06.087378 29463 raft_consensus.cc:1261] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e [term 1 FOLLOWER]: Refusing update from remote peer b782467b568048c7ace5c67f7a7a8efd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:06.088199 29947 consensus_queue.cc:1035] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09d2990e8af4696984a7e5ae4415212" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:06.088717 29931 consensus_queue.cc:1035] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [LEADER]: Connected to new peer: Peer: permanent_uuid: "39850fc924294e83a6161a5f80efe85e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 36913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:06.133195 29949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:06.126816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:35767 (local address 127.26.207.195:37601)
0808 23:33:06.127081 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:06.127088 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:06.127629 (+ 541us) server_negotiation.cc:407] Connection header received
0808 23:33:06.127855 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:06.127861 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:06.127988 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:06.128096 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:06.128820 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:06.129793 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:06.131217 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:06.131835 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:06.131964 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:06.132494 (+ 530us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:06.132604 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:06.132673 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:06.132869 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 23:33:06.132961 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 23:33:06.133458 29958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:06.126570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:37601 (local address 127.26.207.193:35767)
0808 23:33:06.127479 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:06.127500 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:06.127670 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:06.128120 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:06.128124 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:06.128134 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 23:33:06.128564 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:06.128574 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:06.129965 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:06.129969 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:06.131062 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:06.131075 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:06.132123 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:06.132129 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:06.132273 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:06.132315 (+ 42us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 23:33:06.132698 (+ 383us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 23:33:06.132708 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 23:33:06.132796 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 23:33:06.132938 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"thread_start_us":582,"threads_started":1}
W20260808 23:33:06.135280 29897 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 23:33:07.737778 29290 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:07.738108 29290 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:07.743156 29290 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cbb868c0d095491690ef18b5c1b1ae6d: Sending DeleteTablet for 3 replicas of tablet 25f831457a574be38fc78e1623bd3e08
I20260808 23:33:07.744155 29435 tablet_service.cc:1514] Processing DeleteTablet for tablet 25f831457a574be38fc78e1623bd3e08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:07 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:57762
I20260808 23:33:07.744247 29582 tablet_service.cc:1514] Processing DeleteTablet for tablet 25f831457a574be38fc78e1623bd3e08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:07 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:42776
I20260808 23:33:07.744285 29729 tablet_service.cc:1514] Processing DeleteTablet for tablet 25f831457a574be38fc78e1623bd3e08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:07 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:55164
I20260808 23:33:07.745187 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 29365
I20260808 23:33:07.757117 29986 tablet_replica.cc:330] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd: stopping tablet replica
I20260808 23:33:07.757480 29986 raft_consensus.cc:2229] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:33:07.758358 29986 raft_consensus.cc:2258] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:07.759270 29985 tablet_replica.cc:330] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212: stopping tablet replica
I20260808 23:33:07.759583 29985 raft_consensus.cc:2229] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:07.759934 29985 raft_consensus.cc:2258] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:07.761137 29986 ts_tablet_manager.cc:1905] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:07.761435 29985 ts_tablet_manager.cc:1905] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:07.765674 29983 tablet_replica.cc:330] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e: stopping tablet replica
I20260808 23:33:07.765931 29983 raft_consensus.cc:2229] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:07.766376 29983 raft_consensus.cc:2258] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:07.769925 29985 ts_tablet_manager.cc:1918] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 23:33:07.770005 29986 ts_tablet_manager.cc:1918] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 23:33:07.770114 29985 log.cc:1196] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/25f831457a574be38fc78e1623bd3e08
I20260808 23:33:07.770205 29986 log.cc:1196] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/25f831457a574be38fc78e1623bd3e08
I20260808 23:33:07.770653 29985 ts_tablet_manager.cc:1939] T 25f831457a574be38fc78e1623bd3e08 P a09d2990e8af4696984a7e5ae4415212: Deleting consensus metadata
I20260808 23:33:07.770773 29986 ts_tablet_manager.cc:1939] T 25f831457a574be38fc78e1623bd3e08 P b782467b568048c7ace5c67f7a7a8efd: Deleting consensus metadata
I20260808 23:33:07.771960 29277 catalog_manager.cc:4841] TS a09d2990e8af4696984a7e5ae4415212 (127.26.207.194:36583): tablet 25f831457a574be38fc78e1623bd3e08 (table test-table [id=6acaba70fa4949a38d926ad0d6390f5f]) successfully deleted
I20260808 23:33:07.772293 29275 catalog_manager.cc:4841] TS b782467b568048c7ace5c67f7a7a8efd (127.26.207.195:37601): tablet 25f831457a574be38fc78e1623bd3e08 (table test-table [id=6acaba70fa4949a38d926ad0d6390f5f]) successfully deleted
I20260808 23:33:07.772465 29983 ts_tablet_manager.cc:1905] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 23:33:07 dist-test-slave-1x4g krb5kdc[29243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231985, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:33:07.779647 29983 ts_tablet_manager.cc:1918] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 23:33:07.780041 29983 log.cc:1196] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/25f831457a574be38fc78e1623bd3e08
I20260808 23:33:07.780665 29983 ts_tablet_manager.cc:1939] T 25f831457a574be38fc78e1623bd3e08 P 39850fc924294e83a6161a5f80efe85e: Deleting consensus metadata
I20260808 23:33:07.781996 29275 catalog_manager.cc:4841] TS 39850fc924294e83a6161a5f80efe85e (127.26.207.193:36913): tablet 25f831457a574be38fc78e1623bd3e08 (table test-table [id=6acaba70fa4949a38d926ad0d6390f5f]) successfully deleted
I20260808 23:33:07.784122 29988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:07.746854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57816 (local address 127.26.207.193:36913)
0808 23:33:07.758164 (+ 11310us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:07.758176 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:07.762212 (+ 4036us) server_negotiation.cc:407] Connection header received
0808 23:33:07.762298 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:07.762303 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:07.762390 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:07.762492 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:07.764872 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:07.766258 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:07.768358 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:07.769090 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:07.769242 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:07.774929 (+ 5687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:07.774952 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:07.774977 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:07.775040 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:07.780209 (+ 5169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:07.781494 (+ 1285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:07.781505 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:07.781515 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:07.781722 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:07.782278 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:07.782291 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:07.782293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:07.782759 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:07.783111 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:07.783473 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 23:33:07.783728 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10198,"thread_start_us":9965,"threads_started":1}
W20260808 23:33:07.784940 29506 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57816
W20260808 23:33:07.785626 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 29365: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:33:07.785895 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 29365
I20260808 23:33:07.820652 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 29515
Aug 08 23:33:07 dist-test-slave-1x4g krb5kdc[29243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231985, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:33:07.838251 29989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:07.821470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42798 (local address 127.26.207.194:36583)
0808 23:33:07.822077 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:07.822082 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:07.822099 (+ 17us) server_negotiation.cc:407] Connection header received
0808 23:33:07.822160 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:07.822163 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:07.822226 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:07.822323 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:07.823688 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:07.824503 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:07.826041 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:07.826494 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:07.826602 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:07.831672 (+ 5070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:07.831691 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:07.831709 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:07.831757 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:07.835090 (+ 3333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:07.835968 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:07.835975 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:07.835978 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:07.836167 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:07.836515 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:07.836518 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:07.836520 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:07.837046 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:07.837294 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:07.837613 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 23:33:07.837835 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":311,"threads_started":1}
W20260808 23:33:07.839079 29653 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42798
W20260808 23:33:07.839761 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 29515: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:33:07.839986 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 29515
I20260808 23:33:07.869158 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 29662
Aug 08 23:33:07 dist-test-slave-1x4g krb5kdc[29243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231985, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:33:07.887315 29990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:07.870020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55182 (local address 127.26.207.195:37601)
0808 23:33:07.870651 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:07.870655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:07.870675 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:33:07.870735 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:07.870738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:07.870809 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:07.870911 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:07.872307 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:07.873208 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:07.874502 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:07.874918 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:07.875023 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:07.880401 (+ 5378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:07.880436 (+ 35us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:07.880453 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:07.880513 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:07.884076 (+ 3563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:07.884981 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:07.884990 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:07.884992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:07.885164 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:07.885609 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:07.885616 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:07.885624 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:07.886034 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:07.886361 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:07.886674 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 23:33:07.886933 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":344,"threads_started":1}
W20260808 23:33:07.888103 29797 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55182
W20260808 23:33:07.888760 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 29662: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:33:07.889045 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 29662
I20260808 23:33:07.917716 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 29256
I20260808 23:33:07.918963 29334 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:08.042348 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 29256
2026-08-08T23:33:08Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9410 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:33:08 dist-test-slave-1x4g krb5kdc[29994](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:33:08 dist-test-slave-1x4g krb5kdc[29994](info): set up 2 sockets
Aug 08 23:33:08 dist-test-slave-1x4g krb5kdc[29994](info): commencing operation
krb5kdc: starting...
W20260808 23:33:09.209960 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.004s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:33:09 dist-test-slave-1x4g krb5kdc[29994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:33:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:33:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:33:09.459018 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:35397
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:35397
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:09.820163 30008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:09.820513 30008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:09.820688 30008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:09.828449 30008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:33:09.828580 30008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:09.828671 30008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:09.828806 30008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:33:09.828887 30008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:33:09.839282 30008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:35397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:35397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:09.840818 30008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:09.842264 30008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 23:33:09.856298 30008 server_base.cc:1034] running on GCE node
W20260808 23:33:09.856186 30013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:09.856154 30015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:09.856209 30017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:09.857779 30008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:09.859439 30008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:09.860729 30008 hybrid_clock.cc:648] HybridClock initialized: now 1786231989860670 us; error 51 us; skew 500 ppm
I20260808 23:33:09.861212 30008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:09 dist-test-slave-1x4g krb5kdc[29994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231989, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:09.865191 30008 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:33:09.867182 30008 webserver.cc:460] Webserver started at http://127.26.207.254:37551/ using document root <none> and password file <none>
I20260808 23:33:09.868036 30008 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:09.868220 30008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:09.868598 30008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:09.872098 30008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "0f45024b96164aebba435ed600073ec0"
format_stamp: "Formatted at 2026-08-08 23:33:09 on dist-test-slave-1x4g"
server_key: "070df05c24c02219047af5e11132236d"
server_key_iv: "c004ea35944bdf3cd1b4a855be026b8d"
server_key_version: "encryptionkey@0"
I20260808 23:33:09.873073 30008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "0f45024b96164aebba435ed600073ec0"
format_stamp: "Formatted at 2026-08-08 23:33:09 on dist-test-slave-1x4g"
server_key: "070df05c24c02219047af5e11132236d"
server_key_iv: "c004ea35944bdf3cd1b4a855be026b8d"
server_key_version: "encryptionkey@0"
I20260808 23:33:09.879241 30008 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 23:33:09.883515 30024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:09.885176 30008 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 23:33:09.885450 30008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "0f45024b96164aebba435ed600073ec0"
format_stamp: "Formatted at 2026-08-08 23:33:09 on dist-test-slave-1x4g"
server_key: "070df05c24c02219047af5e11132236d"
server_key_iv: "c004ea35944bdf3cd1b4a855be026b8d"
server_key_version: "encryptionkey@0"
I20260808 23:33:09.885703 30008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:09.913774 30008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:09.918817 30008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:09.919193 30008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:09.940212 30008 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:35397
I20260808 23:33:09.940243 30076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:35397 every 8 connection(s)
I20260808 23:33:09.941895 30008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:33:09.945575 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 30008
I20260808 23:33:09.945854 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:33:09.946556 27455 external_mini_cluster.cc:1428] Setting key 2d27da760eea08332e50dfcb3b180947
I20260808 23:33:09.946671 30077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:09.963449 30077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0: Bootstrap starting.
Aug 08 23:33:09 dist-test-slave-1x4g krb5kdc[29994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:09.968149 30077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:09.969823 30077 log.cc:824] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:09.974407 30077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0: No bootstrap required, opened a new log
I20260808 23:33:09.975368 30080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:09.948895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38886 (local address 127.26.207.254:35397)
0808 23:33:09.949915 (+ 1020us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:09.949932 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:09.949995 (+ 63us) server_negotiation.cc:407] Connection header received
0808 23:33:09.952376 (+ 2381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:09.952416 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:09.953107 (+ 691us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:09.953653 (+ 546us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:09.955201 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:09.957290 (+ 2089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:09.958795 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:09.960029 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:09.960283 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:09.965240 (+ 4957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:09.965261 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:09.965287 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:09.965361 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:09.969905 (+ 4544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:09.970984 (+ 1079us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:09.970997 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:09.971009 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:09.971449 (+ 440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:09.972059 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:09.972064 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:09.972066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:09.972679 (+ 613us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:09.973011 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:09.973724 (+ 713us) server_negotiation.cc:299] Negotiation successful
0808 23:33:09.974167 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":710,"thread_start_us":396,"threads_started":1}
I20260808 23:33:09.984009 30077 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f45024b96164aebba435ed600073ec0" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35397 } }
I20260808 23:33:09.984602 30077 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:09.984916 30077 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f45024b96164aebba435ed600073ec0, State: Initialized, Role: FOLLOWER
I20260808 23:33:09.985761 30077 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f45024b96164aebba435ed600073ec0" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35397 } }
I20260808 23:33:09.986109 30077 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:33:09.986264 30077 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:33:09.986411 30077 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:09.988739 30077 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f45024b96164aebba435ed600073ec0" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35397 } }
I20260808 23:33:09.989377 30077 leader_election.cc:302] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f45024b96164aebba435ed600073ec0; no voters:
I20260808 23:33:09.990163 30077 leader_election.cc:288] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:33:09.990329 30083 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:09.991256 30083 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f45024b96164aebba435ed600073ec0, State: Running, Role: LEADER
I20260808 23:33:09.991905 30083 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f45024b96164aebba435ed600073ec0" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35397 } }
I20260808 23:33:09.992965 30077 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:33:09.995066 30084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f45024b96164aebba435ed600073ec0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f45024b96164aebba435ed600073ec0" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35397 } } }
I20260808 23:33:09.996263 30084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:09.995537 30085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f45024b96164aebba435ed600073ec0. Latest consensus state: current_term: 1 leader_uuid: "0f45024b96164aebba435ed600073ec0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f45024b96164aebba435ed600073ec0" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35397 } } }
I20260808 23:33:09.996623 30085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:10.002032 30090 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:33:10.008309 30090 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:33:10.019066 30090 catalog_manager.cc:1347] Generated new cluster ID: a66a588e3c2347c7a412fd862c031b24
I20260808 23:33:10.019243 30090 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:33:10.065802 30090 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:33:10.067904 30090 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:33:10.083580 30090 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f45024b96164aebba435ed600073ec0: Generated new TSK 0
I20260808 23:33:10.084621 30090 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:33:10.145507 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35397
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:10.529222 30104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:10.529572 30104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:10.529752 30104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:10.537774 30104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:10.537925 30104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:10.538102 30104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:33:10.548808 30104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:10.550295 30104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:10.551649 30104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:10.566781 30112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:10.566785 30110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:10.566782 30109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:10.568163 30104 server_base.cc:1034] running on GCE node
I20260808 23:33:10.568989 30104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:10.570212 30104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:10.571498 30104 hybrid_clock.cc:648] HybridClock initialized: now 1786231990571445 us; error 47 us; skew 500 ppm
I20260808 23:33:10.571923 30104 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:10 dist-test-slave-1x4g krb5kdc[29994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231990, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:10.575922 30104 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:33:10.577822 30104 webserver.cc:460] Webserver started at http://127.26.207.193:42657/ using document root <none> and password file <none>
I20260808 23:33:10.578631 30104 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:10.578794 30104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:10.579151 30104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:10.582973 30104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "538ae3d96f62411abcc20f25c47a9d94"
format_stamp: "Formatted at 2026-08-08 23:33:10 on dist-test-slave-1x4g"
server_key: "f9a5445707bb5879aab8a7cb8067d142"
server_key_iv: "175fcf827a5a7963ba26d66641810d57"
server_key_version: "encryptionkey@0"
I20260808 23:33:10.584002 30104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "538ae3d96f62411abcc20f25c47a9d94"
format_stamp: "Formatted at 2026-08-08 23:33:10 on dist-test-slave-1x4g"
server_key: "f9a5445707bb5879aab8a7cb8067d142"
server_key_iv: "175fcf827a5a7963ba26d66641810d57"
server_key_version: "encryptionkey@0"
I20260808 23:33:10.590397 30104 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 23:33:10.594779 30120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:10.596313 30104 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 23:33:10.596531 30104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "538ae3d96f62411abcc20f25c47a9d94"
format_stamp: "Formatted at 2026-08-08 23:33:10 on dist-test-slave-1x4g"
server_key: "f9a5445707bb5879aab8a7cb8067d142"
server_key_iv: "175fcf827a5a7963ba26d66641810d57"
server_key_version: "encryptionkey@0"
I20260808 23:33:10.596818 30104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:10.612577 30104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:10.617622 30104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:10.617990 30104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:10.619094 30104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:10.620752 30104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:10.620936 30104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 23:33:10.621102 30104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:10.621182 30104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:10.658802 30104 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:38767
I20260808 23:33:10.658838 30237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:38767 every 8 connection(s)
I20260808 23:33:10.660228 30104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:33:10.661769 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 30104
I20260808 23:33:10.662039 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:33:10.662863 27455 external_mini_cluster.cc:1428] Setting key d38f6e7d2d91725380928de1aa4dfb68
Aug 08 23:33:10 dist-test-slave-1x4g krb5kdc[29994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231990, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:10.686040 30240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:10.663445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:50941 (local address 127.26.207.254:35397)
0808 23:33:10.664013 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:10.664020 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:10.665306 (+ 1286us) server_negotiation.cc:407] Connection header received
0808 23:33:10.667263 (+ 1957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:10.667269 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:10.667369 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:10.667506 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:10.669324 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:10.670109 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:10.671764 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:10.672269 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:10.672431 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:10.677166 (+ 4735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:10.677177 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:10.677185 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:10.677239 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:10.681415 (+ 4176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:10.682525 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:10.682535 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:10.682541 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:10.682739 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:10.683404 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:10.683413 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:10.683420 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:10.683890 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:10.684090 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:10.685259 (+ 1169us) server_negotiation.cc:299] Negotiation successful
0808 23:33:10.685579 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":287,"threads_started":1}
I20260808 23:33:10.686873 30241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:10.664142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:35397 (local address 127.26.207.193:50941)
0808 23:33:10.665134 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:10.665186 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:10.666944 (+ 1758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:10.667783 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:10.667792 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:10.668410 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:10.669130 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:10.669153 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:10.670298 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:10.670302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:10.671588 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:10.671601 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:10.672557 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:10.672563 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:10.672867 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:10.673729 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:10.673768 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:10.676858 (+ 3090us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:10.681674 (+ 4816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:10.681685 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:10.681702 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:10.682315 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:10.682872 (+ 557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:10.682876 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:10.682878 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:10.683246 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:10.684075 (+ 829us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:10.684109 (+ 34us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:10.684687 (+ 578us) client_negotiation.cc:769] Sending connection context
0808 23:33:10.685070 (+ 383us) client_negotiation.cc:240] Negotiation successful
0808 23:33:10.685580 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"thread_start_us":340,"threads_started":1}
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
I20260808 23:33:10.688969 30238 heartbeater.cc:347] Connected to a master server at 127.26.207.254:35397
I20260808 23:33:10.689584 30238 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:10.690937 30238 heartbeater.cc:511] Master 127.26.207.254:35397 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
I20260808 23:33:10.694001 30041 ts_manager.cc:194] Registered new tserver with Master: 538ae3d96f62411abcc20f25c47a9d94 (127.26.207.193:38767)
I20260808 23:33:10.696120 30041 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:50941
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:33:10.721930 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35397
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:11.083586 30244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:11.084012 30244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:11.084196 30244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:11.093395 30244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:11.093564 30244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:11.093796 30244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:33:11.105057 30244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:11.106542 30244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:11.108006 30244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:11.122730 30250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:11.122782 30249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:11.122749 30252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:11.123993 30244 server_base.cc:1034] running on GCE node
I20260808 23:33:11.124832 30244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:11.126020 30244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:11.127295 30244 hybrid_clock.cc:648] HybridClock initialized: now 1786231991127232 us; error 55 us; skew 500 ppm
I20260808 23:33:11.127694 30244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:11 dist-test-slave-1x4g krb5kdc[29994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231991, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:11.131248 30244 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:33:11.133014 30244 webserver.cc:460] Webserver started at http://127.26.207.194:43137/ using document root <none> and password file <none>
I20260808 23:33:11.133805 30244 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:11.133967 30244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:11.134318 30244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:11.137639 30244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "027eb9c2556b4b1a9f2bbeb4dfb36f23"
format_stamp: "Formatted at 2026-08-08 23:33:11 on dist-test-slave-1x4g"
server_key: "6a81abee3ff5f0ce6970e1f816a632ad"
server_key_iv: "7fcae30e71791f03ae7b42df25da3fe6"
server_key_version: "encryptionkey@0"
I20260808 23:33:11.138535 30244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "027eb9c2556b4b1a9f2bbeb4dfb36f23"
format_stamp: "Formatted at 2026-08-08 23:33:11 on dist-test-slave-1x4g"
server_key: "6a81abee3ff5f0ce6970e1f816a632ad"
server_key_iv: "7fcae30e71791f03ae7b42df25da3fe6"
server_key_version: "encryptionkey@0"
I20260808 23:33:11.144495 30244 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 23:33:11.149251 30259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:11.151010 30244 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 23:33:11.151259 30244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "027eb9c2556b4b1a9f2bbeb4dfb36f23"
format_stamp: "Formatted at 2026-08-08 23:33:11 on dist-test-slave-1x4g"
server_key: "6a81abee3ff5f0ce6970e1f816a632ad"
server_key_iv: "7fcae30e71791f03ae7b42df25da3fe6"
server_key_version: "encryptionkey@0"
I20260808 23:33:11.151518 30244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:11.173857 30244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:11.178961 30244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:11.179323 30244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:11.180482 30244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:11.182054 30244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:11.182174 30244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:11.182345 30244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:11.182422 30244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:11.220343 30244 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:38129
I20260808 23:33:11.220404 30376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:38129 every 8 connection(s)
I20260808 23:33:11.221861 30244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:33:11.227699 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 30244
I20260808 23:33:11.227912 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:33:11.228396 27455 external_mini_cluster.cc:1428] Setting key 40ab81c415dfdae4435acbd23c8c1887
Aug 08 23:33:11 dist-test-slave-1x4g krb5kdc[29994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231991, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:11.248271 30379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:11.224882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:41947 (local address 127.26.207.254:35397)
0808 23:33:11.225399 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:11.225406 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:11.226571 (+ 1165us) server_negotiation.cc:407] Connection header received
0808 23:33:11.228811 (+ 2240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:11.228819 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:11.228926 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:11.229074 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:11.231189 (+ 2115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:11.232354 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:11.234903 (+ 2549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:11.235801 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:11.235974 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:11.240968 (+ 4994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:11.240975 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:11.240978 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:11.241026 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:11.243997 (+ 2971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:11.245080 (+ 1083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:11.245086 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:11.245088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:11.245239 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:11.245782 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:11.245786 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:11.245788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:11.246114 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:11.246299 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:11.247138 (+ 839us) server_negotiation.cc:299] Negotiation successful
0808 23:33:11.247430 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":229,"threads_started":1}
I20260808 23:33:11.250093 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:11.225537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:35397 (local address 127.26.207.194:41947)
0808 23:33:11.226342 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:11.226424 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:11.228384 (+ 1960us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:11.229491 (+ 1107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:11.229505 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:11.230145 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:11.230959 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:11.230982 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:11.232558 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:11.232562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:11.234667 (+ 2105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:11.234691 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:11.236121 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:11.236130 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:11.236480 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:11.237444 (+ 964us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:11.237486 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:11.240606 (+ 3120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:11.244228 (+ 3622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:11.244241 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:11.244272 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:11.244908 (+ 636us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:11.245375 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:11.245381 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:11.245384 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:11.245631 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:11.246270 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:11.246279 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:11.246712 (+ 433us) client_negotiation.cc:769] Sending connection context
0808 23:33:11.247016 (+ 304us) client_negotiation.cc:240] Negotiation successful
0808 23:33:11.247984 (+ 968us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":308,"threads_started":1}
I20260808 23:33:11.251883 30377 heartbeater.cc:347] Connected to a master server at 127.26.207.254:35397
I20260808 23:33:11.252274 30377 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
I20260808 23:33:11.253214 30377 heartbeater.cc:511] Master 127.26.207.254:35397 requested a full tablet report, sending...
I20260808 23:33:11.255174 30041 ts_manager.cc:194] Registered new tserver with Master: 027eb9c2556b4b1a9f2bbeb4dfb36f23 (127.26.207.194:38129)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
I20260808 23:33:11.256290 30041 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:41947
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:33:11.284704 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35397
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:11.650307 30383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:11.650615 30383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:11.650784 30383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:11.658763 30383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:11.658891 30383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:11.659102 30383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:33:11.669804 30383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:11.671296 30383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:11.672680 30383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:11.687860 30388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:11.687826 30389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:11.688880 30392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:11.695317 30383 server_base.cc:1034] running on GCE node
I20260808 23:33:11.696357 30383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:11.698004 30383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:11.699294 30383 hybrid_clock.cc:648] HybridClock initialized: now 1786231991699210 us; error 76 us; skew 500 ppm
I20260808 23:33:11.699812 30383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:33:11.700268 30238 heartbeater.cc:503] Master 127.26.207.254:35397 was elected leader, sending a full tablet report...
Aug 08 23:33:11 dist-test-slave-1x4g krb5kdc[29994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231991, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:11.705235 30383 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:33:11.707289 30383 webserver.cc:460] Webserver started at http://127.26.207.195:39009/ using document root <none> and password file <none>
I20260808 23:33:11.708168 30383 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:11.708319 30383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:11.708693 30383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:11.712323 30383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "3485971d58164bd6a43d48418e4a810a"
format_stamp: "Formatted at 2026-08-08 23:33:11 on dist-test-slave-1x4g"
server_key: "2465be6cd5589bdfa7f4950ac315d7b7"
server_key_iv: "e23f85a8d58e7014912965ff8195128f"
server_key_version: "encryptionkey@0"
I20260808 23:33:11.713341 30383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "3485971d58164bd6a43d48418e4a810a"
format_stamp: "Formatted at 2026-08-08 23:33:11 on dist-test-slave-1x4g"
server_key: "2465be6cd5589bdfa7f4950ac315d7b7"
server_key_iv: "e23f85a8d58e7014912965ff8195128f"
server_key_version: "encryptionkey@0"
I20260808 23:33:11.720036 30383 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 23:33:11.724897 30399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:11.726666 30383 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:33:11.726897 30383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "3485971d58164bd6a43d48418e4a810a"
format_stamp: "Formatted at 2026-08-08 23:33:11 on dist-test-slave-1x4g"
server_key: "2465be6cd5589bdfa7f4950ac315d7b7"
server_key_iv: "e23f85a8d58e7014912965ff8195128f"
server_key_version: "encryptionkey@0"
I20260808 23:33:11.727160 30383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:11.770731 30383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:11.775484 30383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:11.775837 30383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:11.777007 30383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:11.778553 30383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:11.778676 30383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:11.778837 30383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:11.778913 30383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:11.819247 30383 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:42801
I20260808 23:33:11.819347 30515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:42801 every 8 connection(s)
I20260808 23:33:11.820716 30383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:33:11.822436 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 30383
I20260808 23:33:11.822669 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:33:11.823283 27455 external_mini_cluster.cc:1428] Setting key 0e4f9446ff72b1f58ddebf20e93ffd9d
Aug 08 23:33:11 dist-test-slave-1x4g krb5kdc[29994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231991, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:11.844010 30518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:11.823846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:53103 (local address 127.26.207.254:35397)
0808 23:33:11.824391 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:11.824398 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:11.825772 (+ 1374us) server_negotiation.cc:407] Connection header received
0808 23:33:11.827961 (+ 2189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:11.828010 (+ 49us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:11.828197 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:11.828379 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:11.830234 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:11.831129 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:11.832998 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:11.833426 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:11.833586 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:11.837594 (+ 4008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:11.837600 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:11.837604 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:11.837642 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:11.840567 (+ 2925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:11.841506 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:11.841510 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:11.841512 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:11.841700 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:11.842261 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:11.842265 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:11.842267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:11.842574 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:11.842706 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:11.843507 (+ 801us) server_negotiation.cc:299] Negotiation successful
0808 23:33:11.843707 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":292,"threads_started":1}
I20260808 23:33:11.845166 30519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:11.824569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:35397 (local address 127.26.207.195:53103)
0808 23:33:11.825579 (+ 1010us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:11.825630 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:11.827587 (+ 1957us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:11.828678 (+ 1091us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:11.828691 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:11.829381 (+ 690us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:11.830031 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:11.830050 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:11.831338 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:11.831342 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:11.832754 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:11.832828 (+ 74us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:11.833695 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:11.833703 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:11.833974 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:11.834774 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:11.834799 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:11.837291 (+ 2492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:11.840752 (+ 3461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:11.840764 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:11.840812 (+ 48us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:11.841340 (+ 528us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:11.841873 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:11.841878 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:11.841880 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:11.842128 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:11.842713 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:11.842720 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:11.843118 (+ 398us) client_negotiation.cc:769] Sending connection context
0808 23:33:11.843372 (+ 254us) client_negotiation.cc:240] Negotiation successful
0808 23:33:11.843864 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":702,"thread_start_us":460,"threads_started":1}
I20260808 23:33:11.846643 30516 heartbeater.cc:347] Connected to a master server at 127.26.207.254:35397
I20260808 23:33:11.846969 30516 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:11.847707 30516 heartbeater.cc:511] Master 127.26.207.254:35397 requested a full tablet report, sending...
I20260808 23:33:11.849279 30041 ts_manager.cc:194] Registered new tserver with Master: 3485971d58164bd6a43d48418e4a810a (127.26.207.195:42801)
I20260808 23:33:11.850250 30041 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:53103
I20260808 23:33:11.852766 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 23:33:11.895108 30518 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:33:11.891841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38902 (local address 127.26.207.254:35397)
0808 23:33:11.892040 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:11.892045 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:11.892615 (+ 570us) server_negotiation.cc:407] Connection header received
0808 23:33:11.892941 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:11.892946 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:11.893075 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:11.893175 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:11.894780 (+ 1605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38902: BlockingRecv error: recv got EOF from 127.0.0.1:38902 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 23:33:11.898883 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 30104
W20260808 23:33:11.902535 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 30104: Not authorized: Client connection negotiation failed: client connection to 127.26.207.193:38767: server requires authentication, but client does not have Kerberos credentials available
I20260808 23:33:11.902737 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 30104
I20260808 23:33:11.924456 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 30244
W20260808 23:33:11.927839 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 30244: Not authorized: Client connection negotiation failed: client connection to 127.26.207.194:38129: server requires authentication, but client does not have Kerberos credentials available
I20260808 23:33:11.928056 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 30244
W20260808 23:33:11.928143 30529 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:33:11.925748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33396 (local address 127.26.207.194:38129)
0808 23:33:11.926392 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:11.926400 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:11.926427 (+ 27us) server_negotiation.cc:407] Connection header received
0808 23:33:11.926492 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:11.926499 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:11.926716 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:11.926909 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:11.927763 (+ 854us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33396: BlockingRecv error: recv got EOF from 127.0.0.1:33396 (error 108)
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":359,"threads_started":1}
I20260808 23:33:11.949836 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 30383
W20260808 23:33:11.953218 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 30383: Not authorized: Client connection negotiation failed: client connection to 127.26.207.195:42801: server requires authentication, but client does not have Kerberos credentials available
I20260808 23:33:11.953409 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 30383
I20260808 23:33:11.974825 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 30008
I20260808 23:33:11.976217 30072 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:12.083660 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 30008
2026-08-08T23:33:12Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4039 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:33:12 dist-test-slave-1x4g krb5kdc[30534](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:33:12 dist-test-slave-1x4g krb5kdc[30534](info): set up 2 sockets
Aug 08 23:33:12 dist-test-slave-1x4g krb5kdc[30534](info): commencing operation
krb5kdc: starting...
W20260808 23:33:13.258882 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.002s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:33:13 dist-test-slave-1x4g krb5kdc[30534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:33:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:33:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:33:13.526259 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:38027
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:41467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:38027
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:13.893399 30547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:13.893759 30547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:13.893944 30547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:13.901736 30547 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:33:13.901876 30547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:13.901975 30547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:13.902093 30547 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:33:13.902176 30547 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:33:13.912801 30547 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:41467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:38027
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:38027
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:13.914374 30547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:13.915831 30547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:13.929523 30553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:13.929435 30556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:13.929474 30554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:13.931164 30547 server_base.cc:1034] running on GCE node
I20260808 23:33:13.932147 30547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:13.933827 30547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:13.935113 30547 hybrid_clock.cc:648] HybridClock initialized: now 1786231993935048 us; error 41 us; skew 500 ppm
I20260808 23:33:13.935520 30547 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:13 dist-test-slave-1x4g krb5kdc[30534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231993, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:13.944623 30547 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:33:13.946518 30547 webserver.cc:460] Webserver started at http://127.26.207.254:46169/ using document root <none> and password file <none>
I20260808 23:33:13.947337 30547 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:13.947508 30547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:13.947872 30547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:13.951301 30547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "607715740c0947d78af00656c959652b"
format_stamp: "Formatted at 2026-08-08 23:33:13 on dist-test-slave-1x4g"
server_key: "915394c0636af5d162602dba9e7e8c96"
server_key_iv: "17caedd1effd6b6bff50081994fb672c"
server_key_version: "encryptionkey@0"
I20260808 23:33:13.952246 30547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "607715740c0947d78af00656c959652b"
format_stamp: "Formatted at 2026-08-08 23:33:13 on dist-test-slave-1x4g"
server_key: "915394c0636af5d162602dba9e7e8c96"
server_key_iv: "17caedd1effd6b6bff50081994fb672c"
server_key_version: "encryptionkey@0"
I20260808 23:33:13.958591 30547 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260808 23:33:13.962698 30563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:13.964206 30547 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 23:33:13.964453 30547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "607715740c0947d78af00656c959652b"
format_stamp: "Formatted at 2026-08-08 23:33:13 on dist-test-slave-1x4g"
server_key: "915394c0636af5d162602dba9e7e8c96"
server_key_iv: "17caedd1effd6b6bff50081994fb672c"
server_key_version: "encryptionkey@0"
I20260808 23:33:13.964695 30547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:13.983275 30547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:13.988306 30547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:13.988646 30547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:14.010361 30547 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:38027
I20260808 23:33:14.010385 30617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:38027 every 8 connection(s)
I20260808 23:33:14.012043 30547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:33:14.014403 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 30547
I20260808 23:33:14.014710 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:33:14.015601 27455 external_mini_cluster.cc:1428] Setting key bb79beea4940dffb484a0790b454a6bc
I20260808 23:33:14.018453 30618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 23:33:14 dist-test-slave-1x4g krb5kdc[30534](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:14.033492 30618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b: Bootstrap starting.
I20260808 23:33:14.038245 30618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:14.039788 30618 log.cc:824] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:14.044165 30618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b: No bootstrap required, opened a new log
I20260808 23:33:14.045361 30621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:14.017949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55844 (local address 127.26.207.254:38027)
0808 23:33:14.019004 (+ 1055us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:14.019017 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:14.019063 (+ 46us) server_negotiation.cc:407] Connection header received
0808 23:33:14.020928 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:14.020954 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:14.021427 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:14.021815 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:14.023972 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:14.025575 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:14.027573 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:14.028944 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:14.029175 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:14.034811 (+ 5636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:14.034824 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:14.034845 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:14.034911 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:14.039487 (+ 4576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:14.040740 (+ 1253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:14.040750 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:14.040759 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:14.041028 (+ 269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:14.041600 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:14.041605 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:14.041608 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:14.042508 (+ 900us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:14.042844 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:14.043332 (+ 488us) server_negotiation.cc:299] Negotiation successful
0808 23:33:14.043837 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":816,"thread_start_us":532,"threads_started":1}
I20260808 23:33:14.050606 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:33:14.053810 30618 raft_consensus.cc:348] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607715740c0947d78af00656c959652b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38027 } }
I20260808 23:33:14.054252 30618 raft_consensus.cc:374] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:14.054711 30618 raft_consensus.cc:729] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 607715740c0947d78af00656c959652b, State: Initialized, Role: FOLLOWER
I20260808 23:33:14.056460 30618 consensus_queue.cc:260] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607715740c0947d78af00656c959652b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38027 } }
I20260808 23:33:14.056912 30618 raft_consensus.cc:388] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:33:14.057097 30618 raft_consensus.cc:482] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:33:14.057319 30618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:14.059825 30618 raft_consensus.cc:504] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607715740c0947d78af00656c959652b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38027 } }
I20260808 23:33:14.060521 30618 leader_election.cc:302] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 607715740c0947d78af00656c959652b; no voters:
I20260808 23:33:14.061359 30618 leader_election.cc:288] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:33:14.061474 30624 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:14.062860 30624 raft_consensus.cc:686] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [term 1 LEADER]: Becoming Leader. State: Replica: 607715740c0947d78af00656c959652b, State: Running, Role: LEADER
I20260808 23:33:14.063663 30624 consensus_queue.cc:237] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607715740c0947d78af00656c959652b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38027 } }
I20260808 23:33:14.064266 30618 sys_catalog.cc:564] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:33:14.067049 30626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 607715740c0947d78af00656c959652b. Latest consensus state: current_term: 1 leader_uuid: "607715740c0947d78af00656c959652b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607715740c0947d78af00656c959652b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38027 } } }
I20260808 23:33:14.067616 30625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "607715740c0947d78af00656c959652b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607715740c0947d78af00656c959652b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38027 } } }
I20260808 23:33:14.068053 30626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:14.068053 30625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:14.073930 30634 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:33:14.088001 30634 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:33:14.103960 30634 catalog_manager.cc:1347] Generated new cluster ID: c0b24a5a47d4483e93c8be82c61680ab
I20260808 23:33:14.104102 30634 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:33:14.122105 30621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:14.113443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55854 (local address 127.26.207.254:38027)
0808 23:33:14.113647 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:14.113654 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:14.114321 (+ 667us) server_negotiation.cc:407] Connection header received
0808 23:33:14.114566 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:14.114578 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:14.114654 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:14.114772 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:14.115915 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:14.116753 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:14.118206 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:14.118773 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:14.118922 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:14.120136 (+ 1214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:14.120141 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:14.120145 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:14.121053 (+ 908us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:14.121115 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:14.121148 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:14.121287 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:14.121430 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 23:33:14.121550 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 23:33:14.134516 30634 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:33:14.135946 30634 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:33:14.142154 30634 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 607715740c0947d78af00656c959652b: Generated new TSK 0
I20260808 23:33:14.143106 30634 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:33:14.154417 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 30547
I20260808 23:33:14.155889 30613 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:14.250787 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 30547
2026-08-08T23:33:14Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2160 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:33:14 dist-test-slave-1x4g krb5kdc[30654](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:33:14 dist-test-slave-1x4g krb5kdc[30654](info): set up 2 sockets
Aug 08 23:33:14 dist-test-slave-1x4g krb5kdc[30654](info): commencing operation
krb5kdc: starting...
W20260808 23:33:15.399032 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.004s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:33:15 dist-test-slave-1x4g krb5kdc[30654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231995, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:33:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:33:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:33:15.669693 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:35837
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:44577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:35837
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:16.029052 30668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:16.029384 30668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:16.029567 30668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:16.037655 30668 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:33:16.037806 30668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:16.037897 30668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:16.038014 30668 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:33:16.038106 30668 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:33:16.048756 30668 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:35837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:35837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:16.050316 30668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:16.051728 30668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:16.064677 30674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:16.064682 30675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:16.064731 30677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:16.065752 30668 server_base.cc:1034] running on GCE node
I20260808 23:33:16.066694 30668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:16.068360 30668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:16.069670 30668 hybrid_clock.cc:648] HybridClock initialized: now 1786231996069617 us; error 70 us; skew 500 ppm
I20260808 23:33:16.070164 30668 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:16 dist-test-slave-1x4g krb5kdc[30654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231996, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:16.073761 30668 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:33:16.075608 30668 webserver.cc:460] Webserver started at http://127.26.207.254:42703/ using document root <none> and password file <none>
I20260808 23:33:16.076426 30668 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:16.076613 30668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:16.077039 30668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:16.080438 30668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "5d8531d77e794a6eabe9a4739de66622"
format_stamp: "Formatted at 2026-08-08 23:33:16 on dist-test-slave-1x4g"
server_key: "0a8e8affcd78cefff422aa981caa5e97"
server_key_iv: "0b908aec3d85c879f2cb54ec014cb08e"
server_key_version: "encryptionkey@0"
I20260808 23:33:16.081351 30668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "5d8531d77e794a6eabe9a4739de66622"
format_stamp: "Formatted at 2026-08-08 23:33:16 on dist-test-slave-1x4g"
server_key: "0a8e8affcd78cefff422aa981caa5e97"
server_key_iv: "0b908aec3d85c879f2cb54ec014cb08e"
server_key_version: "encryptionkey@0"
I20260808 23:33:16.087468 30668 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 23:33:16.091745 30684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:16.093945 30668 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260808 23:33:16.094164 30668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "5d8531d77e794a6eabe9a4739de66622"
format_stamp: "Formatted at 2026-08-08 23:33:16 on dist-test-slave-1x4g"
server_key: "0a8e8affcd78cefff422aa981caa5e97"
server_key_iv: "0b908aec3d85c879f2cb54ec014cb08e"
server_key_version: "encryptionkey@0"
I20260808 23:33:16.094389 30668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:16.133276 30668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:16.137874 30668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:16.138226 30668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:16.159813 30668 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:35837
I20260808 23:33:16.159837 30741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:35837 every 8 connection(s)
I20260808 23:33:16.161510 30668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:33:16.165784 30742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:16.166814 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 30668
I20260808 23:33:16.167066 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:33:16.167950 27455 external_mini_cluster.cc:1428] Setting key 20a4a0d5e752e4d5de0880b2368074bd
I20260808 23:33:16.180677 30742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622: Bootstrap starting.
Aug 08 23:33:16 dist-test-slave-1x4g krb5kdc[30654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231995, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:16.184444 30742 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:16.185791 30742 log.cc:824] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:16.189327 30742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622: No bootstrap required, opened a new log
I20260808 23:33:16.193552 30745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:16.170635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49104 (local address 127.26.207.254:35837)
0808 23:33:16.171603 (+ 968us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:16.171616 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:16.171669 (+ 53us) server_negotiation.cc:407] Connection header received
0808 23:33:16.173602 (+ 1933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:16.173634 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:16.174132 (+ 498us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:16.174668 (+ 536us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:16.176316 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:16.177817 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:16.179242 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:16.180034 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:16.180267 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:16.184947 (+ 4680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:16.184958 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:16.184979 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:16.185026 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:16.188457 (+ 3431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:16.189418 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:16.189425 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:16.189434 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:16.189673 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:16.190124 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:16.190136 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:16.190140 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:16.190742 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:16.191119 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:16.191643 (+ 524us) server_negotiation.cc:299] Negotiation successful
0808 23:33:16.192263 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":413,"threads_started":1}
I20260808 23:33:16.198240 30742 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d8531d77e794a6eabe9a4739de66622" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35837 } }
I20260808 23:33:16.198766 30742 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:16.198894 30742 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d8531d77e794a6eabe9a4739de66622, State: Initialized, Role: FOLLOWER
I20260808 23:33:16.199656 30742 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d8531d77e794a6eabe9a4739de66622" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35837 } }
I20260808 23:33:16.199968 30742 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:33:16.200145 30742 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:33:16.200356 30742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:16.202862 30742 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d8531d77e794a6eabe9a4739de66622" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35837 } }
I20260808 23:33:16.203490 30742 leader_election.cc:302] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d8531d77e794a6eabe9a4739de66622; no voters:
I20260808 23:33:16.204228 30742 leader_election.cc:288] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:33:16.204422 30747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:16.205853 30747 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [term 1 LEADER]: Becoming Leader. State: Replica: 5d8531d77e794a6eabe9a4739de66622, State: Running, Role: LEADER
I20260808 23:33:16.206426 30747 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d8531d77e794a6eabe9a4739de66622" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35837 } }
I20260808 23:33:16.206861 30742 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:33:16.209362 30749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d8531d77e794a6eabe9a4739de66622. Latest consensus state: current_term: 1 leader_uuid: "5d8531d77e794a6eabe9a4739de66622" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d8531d77e794a6eabe9a4739de66622" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35837 } } }
I20260808 23:33:16.209827 30749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:16.210414 30748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d8531d77e794a6eabe9a4739de66622" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d8531d77e794a6eabe9a4739de66622" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35837 } } }
I20260808 23:33:16.210847 30748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:16.213686 30753 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:33:16.219321 30753 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:33:16.229421 30753 catalog_manager.cc:1347] Generated new cluster ID: bb05a3cb24ba440dbdaeaa2a17a58b91
I20260808 23:33:16.229569 30753 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:33:16.262950 30753 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:33:16.264578 30753 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:33:16.276232 30753 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d8531d77e794a6eabe9a4739de66622: Generated new TSK 0
I20260808 23:33:16.277357 30753 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:33:16.345947 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35837
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:44577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:16.735826 30770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:16.736148 30770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:16.736310 30770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:16.744253 30770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:16.744382 30770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:16.744565 30770 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:33:16.755276 30770 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:16.756846 30770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:16.758343 30770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:16.773568 30776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:16.773620 30777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:16.773653 30779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:16.774940 30770 server_base.cc:1034] running on GCE node
I20260808 23:33:16.775821 30770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:16.777143 30770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:16.778453 30770 hybrid_clock.cc:648] HybridClock initialized: now 1786231996778386 us; error 55 us; skew 500 ppm
I20260808 23:33:16.778880 30770 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:16 dist-test-slave-1x4g krb5kdc[30654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231996, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:16.782720 30770 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:33:16.784403 30770 webserver.cc:460] Webserver started at http://127.26.207.193:44331/ using document root <none> and password file <none>
I20260808 23:33:16.785277 30770 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:16.785391 30770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:16.785667 30770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:16.789063 30770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "5310437c1c8440739dc611b53bd04540"
format_stamp: "Formatted at 2026-08-08 23:33:16 on dist-test-slave-1x4g"
server_key: "b72a26805c70f310073cb50522fd15b4"
server_key_iv: "e28af1cb1885bb8778103bae549269be"
server_key_version: "encryptionkey@0"
I20260808 23:33:16.790014 30770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "5310437c1c8440739dc611b53bd04540"
format_stamp: "Formatted at 2026-08-08 23:33:16 on dist-test-slave-1x4g"
server_key: "b72a26805c70f310073cb50522fd15b4"
server_key_iv: "e28af1cb1885bb8778103bae549269be"
server_key_version: "encryptionkey@0"
I20260808 23:33:16.796274 30770 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 23:33:16.800655 30787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:16.802506 30770 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:33:16.802769 30770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "5310437c1c8440739dc611b53bd04540"
format_stamp: "Formatted at 2026-08-08 23:33:16 on dist-test-slave-1x4g"
server_key: "b72a26805c70f310073cb50522fd15b4"
server_key_iv: "e28af1cb1885bb8778103bae549269be"
server_key_version: "encryptionkey@0"
I20260808 23:33:16.803030 30770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:16.823524 30770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:16.829635 30770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:16.830084 30770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:16.831918 30770 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:16.837802 30770 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:16.837993 30770 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 23:33:16.838202 30770 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:16.838313 30770 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:16.877238 30770 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:40129
I20260808 23:33:16.877274 30901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:40129 every 8 connection(s)
I20260808 23:33:16.878697 30770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:33:16.888330 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 30770
I20260808 23:33:16.888588 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:33:16.889389 27455 external_mini_cluster.cc:1428] Setting key 9d000caa765ad93a2d169f2f08d73f9e
Aug 08 23:33:16 dist-test-slave-1x4g krb5kdc[30654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231996, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:16.903815 30904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:16.881568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:46247 (local address 127.26.207.254:35837)
0808 23:33:16.882091 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:16.882097 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:16.883153 (+ 1056us) server_negotiation.cc:407] Connection header received
0808 23:33:16.885175 (+ 2022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:16.885181 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:16.885283 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:16.885407 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:16.887120 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:16.887922 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:16.889855 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:16.890459 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:16.890625 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:16.895517 (+ 4892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:16.895527 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:16.895535 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:16.895597 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:16.899637 (+ 4040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:16.900850 (+ 1213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:16.900855 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:16.900858 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:16.901040 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:16.901700 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:16.901704 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:16.901707 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:16.902067 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:16.902212 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:16.903305 (+ 1093us) server_negotiation.cc:299] Negotiation successful
0808 23:33:16.903533 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":253,"threads_started":1}
I20260808 23:33:16.905565 30905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:16.882204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:35837 (local address 127.26.207.193:46247)
0808 23:33:16.882964 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:16.883013 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:16.884865 (+ 1852us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:16.885731 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:16.885741 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:16.886308 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:16.886923 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:16.886943 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:16.888103 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:16.888108 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:16.889676 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:16.889692 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:16.891000 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:16.891008 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:16.891376 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:16.892285 (+ 909us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:16.892328 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:16.895198 (+ 2870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:16.899887 (+ 4689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:16.899897 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:16.899914 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:16.900608 (+ 694us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:16.901170 (+ 562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:16.901177 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:16.901182 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:16.901514 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:16.902238 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:16.902250 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:16.902808 (+ 558us) client_negotiation.cc:769] Sending connection context
0808 23:33:16.903154 (+ 346us) client_negotiation.cc:240] Negotiation successful
0808 23:33:16.903835 (+ 681us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":300,"threads_started":1}
I20260808 23:33:16.907470 30902 heartbeater.cc:347] Connected to a master server at 127.26.207.254:35837
I20260808 23:33:16.907838 30902 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:16.908941 30902 heartbeater.cc:511] Master 127.26.207.254:35837 requested a full tablet report, sending...
I20260808 23:33:16.911298 30705 ts_manager.cc:194] Registered new tserver with Master: 5310437c1c8440739dc611b53bd04540 (127.26.207.193:40129)
I20260808 23:33:16.912915 30705 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:46247
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:33:16.949292 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35837
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:44577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:17.322278 30908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:17.322631 30908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:17.322738 30908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:17.330536 30908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:17.330677 30908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:17.330794 30908 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:33:17.341073 30908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:17.342451 30908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:17.343832 30908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:17.358250 30913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:17.358176 30914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:17.358264 30916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:17.359143 30908 server_base.cc:1034] running on GCE node
I20260808 23:33:17.359894 30908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:17.361073 30908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:17.362387 30908 hybrid_clock.cc:648] HybridClock initialized: now 1786231997362312 us; error 49 us; skew 500 ppm
I20260808 23:33:17.362807 30908 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:17 dist-test-slave-1x4g krb5kdc[30654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231997, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:17.366739 30908 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:33:17.368734 30908 webserver.cc:460] Webserver started at http://127.26.207.194:38405/ using document root <none> and password file <none>
I20260808 23:33:17.369642 30908 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:17.369832 30908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:17.370223 30908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:17.373855 30908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "e8286f7ad22c491bbfe040755ff5eaf6"
format_stamp: "Formatted at 2026-08-08 23:33:17 on dist-test-slave-1x4g"
server_key: "62f694fa2e970b2fbab3f86ad37f1c7a"
server_key_iv: "8b5bca25790c40e4b8ac13e8e3c14046"
server_key_version: "encryptionkey@0"
I20260808 23:33:17.374898 30908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "e8286f7ad22c491bbfe040755ff5eaf6"
format_stamp: "Formatted at 2026-08-08 23:33:17 on dist-test-slave-1x4g"
server_key: "62f694fa2e970b2fbab3f86ad37f1c7a"
server_key_iv: "8b5bca25790c40e4b8ac13e8e3c14046"
server_key_version: "encryptionkey@0"
I20260808 23:33:17.381729 30908 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 23:33:17.386291 30926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:17.387934 30908 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260808 23:33:17.388187 30908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "e8286f7ad22c491bbfe040755ff5eaf6"
format_stamp: "Formatted at 2026-08-08 23:33:17 on dist-test-slave-1x4g"
server_key: "62f694fa2e970b2fbab3f86ad37f1c7a"
server_key_iv: "8b5bca25790c40e4b8ac13e8e3c14046"
server_key_version: "encryptionkey@0"
I20260808 23:33:17.388446 30908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:17.411957 30908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:17.417490 30908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:17.417858 30908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:17.419029 30908 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:17.420687 30908 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:17.420832 30908 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 23:33:17.421018 30908 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:17.421098 30908 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:17.460060 30908 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:36043
I20260808 23:33:17.460161 31043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:36043 every 8 connection(s)
I20260808 23:33:17.462093 30908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:33:17.466493 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 30908
I20260808 23:33:17.466710 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:33:17.467231 27455 external_mini_cluster.cc:1428] Setting key 48dcbed004bd21059099d240f9553650
Aug 08 23:33:17 dist-test-slave-1x4g krb5kdc[30654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231997, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:17.489099 31046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:17.465463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:53333 (local address 127.26.207.254:35837)
0808 23:33:17.465959 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:17.465965 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:17.467171 (+ 1206us) server_negotiation.cc:407] Connection header received
0808 23:33:17.469233 (+ 2062us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:17.469238 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:17.469331 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:17.469425 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:17.471863 (+ 2438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:17.472643 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:17.475567 (+ 2924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:17.476036 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:17.476162 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:17.480762 (+ 4600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:17.480773 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:17.480799 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:17.480854 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:17.484921 (+ 4067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:17.486039 (+ 1118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:17.486048 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:17.486054 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:17.486229 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:17.486743 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:17.486752 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:17.486758 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:17.487221 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:17.487404 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:17.488190 (+ 786us) server_negotiation.cc:299] Negotiation successful
0808 23:33:17.488505 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":270,"threads_started":1}
I20260808 23:33:17.489884 31047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:17.466030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:35837 (local address 127.26.207.194:53333)
0808 23:33:17.466966 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:17.467025 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:17.468942 (+ 1917us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:17.469763 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:17.469777 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:17.470661 (+ 884us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:17.471622 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:17.471655 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:17.472887 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:17.472896 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:17.475309 (+ 2413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:17.475334 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:17.476322 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:17.476331 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:17.476735 (+ 404us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:17.477733 (+ 998us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:17.477771 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:17.480435 (+ 2664us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:17.485222 (+ 4787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:17.485233 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:17.485251 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:17.485845 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:17.486352 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:17.486355 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:17.486357 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:17.486570 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:17.487358 (+ 788us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:17.487365 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:17.487760 (+ 395us) client_negotiation.cc:769] Sending connection context
0808 23:33:17.488014 (+ 254us) client_negotiation.cc:240] Negotiation successful
0808 23:33:17.488477 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"thread_start_us":422,"threads_started":1}
I20260808 23:33:17.491729 31044 heartbeater.cc:347] Connected to a master server at 127.26.207.254:35837
I20260808 23:33:17.492101 31044 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:17.493155 31044 heartbeater.cc:511] Master 127.26.207.254:35837 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
I20260808 23:33:17.495112 30705 ts_manager.cc:194] Registered new tserver with Master: e8286f7ad22c491bbfe040755ff5eaf6 (127.26.207.194:36043)
I20260808 23:33:17.496042 30705 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:53333
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:33:17.529112 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35837
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:44577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:17.895489 31050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:17.895831 31050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:17.895936 31050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:17.904023 31050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:17.904160 31050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:17.904280 31050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:33:17.915324 31050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:17.916543 30902 heartbeater.cc:503] Master 127.26.207.254:35837 was elected leader, sending a full tablet report...
I20260808 23:33:17.916919 31050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:17.918893 31050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:17.933959 31059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:17.934141 31056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:17.934141 31057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:17.935155 31050 server_base.cc:1034] running on GCE node
I20260808 23:33:17.935982 31050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:17.937233 31050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:17.938483 31050 hybrid_clock.cc:648] HybridClock initialized: now 1786231997938428 us; error 59 us; skew 500 ppm
I20260808 23:33:17.938851 31050 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:17 dist-test-slave-1x4g krb5kdc[30654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231997, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:17.942441 31050 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:33:17.944247 31050 webserver.cc:460] Webserver started at http://127.26.207.195:42847/ using document root <none> and password file <none>
I20260808 23:33:17.945120 31050 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:17.945281 31050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:17.945626 31050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:17.948889 31050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "937b156a1a0345b8b82307495f4e3176"
format_stamp: "Formatted at 2026-08-08 23:33:17 on dist-test-slave-1x4g"
server_key: "7d561fb9c36de1b18fe2922478a9f9c2"
server_key_iv: "e3c2aa979ee3b70605ed5c2cd8279066"
server_key_version: "encryptionkey@0"
I20260808 23:33:17.949774 31050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "937b156a1a0345b8b82307495f4e3176"
format_stamp: "Formatted at 2026-08-08 23:33:17 on dist-test-slave-1x4g"
server_key: "7d561fb9c36de1b18fe2922478a9f9c2"
server_key_iv: "e3c2aa979ee3b70605ed5c2cd8279066"
server_key_version: "encryptionkey@0"
I20260808 23:33:17.955739 31050 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 23:33:17.960028 31067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:17.961740 31050 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:33:17.961982 31050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "937b156a1a0345b8b82307495f4e3176"
format_stamp: "Formatted at 2026-08-08 23:33:17 on dist-test-slave-1x4g"
server_key: "7d561fb9c36de1b18fe2922478a9f9c2"
server_key_iv: "e3c2aa979ee3b70605ed5c2cd8279066"
server_key_version: "encryptionkey@0"
I20260808 23:33:17.962230 31050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:17.984678 31050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:17.989455 31050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:17.989825 31050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:17.990954 31050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:17.992630 31050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:17.992719 31050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:17.992911 31050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:17.992974 31050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:18.029357 31050 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:40907
I20260808 23:33:18.029407 31188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:40907 every 8 connection(s)
I20260808 23:33:18.030839 31050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:33:18.036356 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 31050
I20260808 23:33:18.036578 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:33:18.037117 27455 external_mini_cluster.cc:1428] Setting key 577c3593e947cb9ba5c8b80e5283d3e8
Aug 08 23:33:18 dist-test-slave-1x4g krb5kdc[30654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231997, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:18.052918 31191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:18.033788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:54545 (local address 127.26.207.254:35837)
0808 23:33:18.034318 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:18.034324 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:18.035401 (+ 1077us) server_negotiation.cc:407] Connection header received
0808 23:33:18.037568 (+ 2167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:18.037574 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:18.037681 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:18.037829 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:18.039514 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:18.040365 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:18.042156 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:18.042599 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:18.042746 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:18.046655 (+ 3909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:18.046661 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:18.046664 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:18.046704 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:18.049403 (+ 2699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:18.050278 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:18.050282 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:18.050285 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:18.050425 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:18.050917 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:18.050921 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:18.050923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:18.051247 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:18.051427 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:18.052232 (+ 805us) server_negotiation.cc:299] Negotiation successful
0808 23:33:18.052483 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":244,"threads_started":1}
I20260808 23:33:18.053927 31192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:18.034414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:35837 (local address 127.26.207.195:54545)
0808 23:33:18.035210 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:18.035265 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:18.037233 (+ 1968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:18.038113 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:18.038123 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:18.038689 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:18.039314 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:18.039333 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:18.040535 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:18.040546 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:18.041966 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:18.041984 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:18.042872 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:18.042880 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:18.043148 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:18.043855 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:18.043884 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:18.046369 (+ 2485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:18.049590 (+ 3221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:18.049601 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:18.049627 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:18.050119 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:18.050548 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:18.050554 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:18.050557 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:18.050774 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:18.051393 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:18.051402 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:18.051802 (+ 400us) client_negotiation.cc:769] Sending connection context
0808 23:33:18.052092 (+ 290us) client_negotiation.cc:240] Negotiation successful
0808 23:33:18.052703 (+ 611us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":305,"threads_started":1}
I20260808 23:33:18.055604 31189 heartbeater.cc:347] Connected to a master server at 127.26.207.254:35837
I20260808 23:33:18.055960 31189 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:18.056944 31189 heartbeater.cc:511] Master 127.26.207.254:35837 requested a full tablet report, sending...
I20260808 23:33:18.058758 30705 ts_manager.cc:194] Registered new tserver with Master: 937b156a1a0345b8b82307495f4e3176 (127.26.207.195:40907)
I20260808 23:33:18.059725 30705 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:54545
I20260808 23:33:18.065570 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 23:33:18 dist-test-slave-1x4g krb5kdc[30654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231998, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 23:33:18 dist-test-slave-1x4g krb5kdc[30654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231998, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:18.129154 31191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:18.112197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49112 (local address 127.26.207.254:35837)
0808 23:33:18.112514 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:18.112528 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:18.113100 (+ 572us) server_negotiation.cc:407] Connection header received
0808 23:33:18.113328 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:18.113336 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:18.113432 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:18.113581 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:18.115626 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:18.116462 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:18.118096 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:18.118554 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:18.118676 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:18.123229 (+ 4553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:18.123235 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:18.123239 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:18.123285 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:18.126000 (+ 2715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:18.126874 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:18.126879 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:18.126882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:18.127040 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:18.127504 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:18.127508 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:18.127510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:18.127871 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:18.128164 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:18.128514 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 23:33:18.128803 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260808 23:33:18.129818 30705 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:49112
I20260808 23:33:18.131924 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 30770
Aug 08 23:33:18 dist-test-slave-1x4g krb5kdc[30654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231998, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:33:18.149597 31201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:18.133194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53864 (local address 127.26.207.193:40129)
0808 23:33:18.133892 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:18.133900 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:18.133925 (+ 25us) server_negotiation.cc:407] Connection header received
0808 23:33:18.133985 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:18.133991 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:18.134206 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:18.134380 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:18.135692 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:18.136898 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:18.138226 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:18.138848 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:18.139010 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:18.143402 (+ 4392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:18.143419 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:18.143436 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:18.143509 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:18.146624 (+ 3115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:18.147439 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:18.147446 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:18.147448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:18.147593 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:18.148043 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:18.148046 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:18.148048 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:18.148423 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:18.148662 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:18.149051 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 23:33:18.149291 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":315,"threads_started":1}
W20260808 23:33:18.151002 30897 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:53864
W20260808 23:33:18.152264 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 30770: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:33:18.152525 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 30770
I20260808 23:33:18.177650 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 30908
Aug 08 23:33:18 dist-test-slave-1x4g krb5kdc[30654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231998, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:33:18.196530 31202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:18.178772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50676 (local address 127.26.207.194:36043)
0808 23:33:18.179408 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:18.179418 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:18.179454 (+ 36us) server_negotiation.cc:407] Connection header received
0808 23:33:18.179535 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:18.179545 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:18.179800 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:18.179944 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:18.181376 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:18.182408 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:18.183831 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:18.184466 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:18.184589 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:18.189435 (+ 4846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:18.189454 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:18.189478 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:18.189546 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:18.193142 (+ 3596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:18.194005 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:18.194015 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:18.194018 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:18.194180 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:18.194636 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:18.194643 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:18.194652 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:18.195050 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:18.195452 (+ 402us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:18.195803 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 23:33:18.196117 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":322,"threads_started":1}
W20260808 23:33:18.198129 31039 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:50676
W20260808 23:33:18.199688 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 30908: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:33:18.199892 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 30908
I20260808 23:33:18.222494 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 31050
Aug 08 23:33:18 dist-test-slave-1x4g krb5kdc[30654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231998, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:33:18.242116 31203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:18.223696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48160 (local address 127.26.207.195:40907)
0808 23:33:18.224435 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:18.224443 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:18.224477 (+ 34us) server_negotiation.cc:407] Connection header received
0808 23:33:18.224561 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:18.224567 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:18.225042 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:18.225262 (+ 220us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:18.226857 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:18.227995 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:18.229586 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:18.230200 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:18.230359 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:18.235437 (+ 5078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:18.235456 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:18.235474 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:18.235529 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:18.238672 (+ 3143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:18.239648 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:18.239656 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:18.239658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:18.239805 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:18.240216 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:18.240219 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:18.240221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:18.240617 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:18.240957 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:18.241375 (+ 418us) server_negotiation.cc:299] Negotiation successful
0808 23:33:18.241649 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":400,"threads_started":1}
W20260808 23:33:18.243688 31184 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:48160
W20260808 23:33:18.245062 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 31050: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:33:18.245296 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 31050
I20260808 23:33:18.266793 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 30668
I20260808 23:33:18.268116 30737 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:18.377373 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 30668
2026-08-08T23:33:18Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4133 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:33:18 dist-test-slave-1x4g krb5kdc[31207](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:33:18 dist-test-slave-1x4g krb5kdc[31207](info): set up 2 sockets
Aug 08 23:33:18 dist-test-slave-1x4g krb5kdc[31207](info): commencing operation
krb5kdc: starting...
W20260808 23:33:19.551234 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:33:19 dist-test-slave-1x4g krb5kdc[31207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:33:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:33:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:33:19.813723 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:44011
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:44011
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:20.175199 31222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:20.175554 31222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:20.175649 31222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:20.184474 31222 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:33:20.184648 31222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:20.184703 31222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:20.184757 31222 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:33:20.184868 31222 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:33:20.196123 31222 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:44011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:44011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:20.197630 31222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:20.199128 31222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:20.212684 31227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:20.212760 31230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:20.212743 31228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:20.214530 31222 server_base.cc:1034] running on GCE node
I20260808 23:33:20.215588 31222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:20.217439 31222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:20.218685 31222 hybrid_clock.cc:648] HybridClock initialized: now 1786232000218639 us; error 41 us; skew 500 ppm
I20260808 23:33:20.219103 31222 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:20 dist-test-slave-1x4g krb5kdc[31207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232000, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:20.228317 31222 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:33:20.230437 31222 webserver.cc:460] Webserver started at http://127.26.207.254:37357/ using document root <none> and password file <none>
I20260808 23:33:20.231308 31222 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:20.231467 31222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:20.231858 31222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:20.235411 31222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "58e1dba201db4b7a9fac4bc46cfba9e3"
format_stamp: "Formatted at 2026-08-08 23:33:20 on dist-test-slave-1x4g"
server_key: "f0c8ad91d5c7fee12ec93a71bbae63e6"
server_key_iv: "7417144a2c36d65edf1ae637b45066d3"
server_key_version: "encryptionkey@0"
I20260808 23:33:20.236368 31222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "58e1dba201db4b7a9fac4bc46cfba9e3"
format_stamp: "Formatted at 2026-08-08 23:33:20 on dist-test-slave-1x4g"
server_key: "f0c8ad91d5c7fee12ec93a71bbae63e6"
server_key_iv: "7417144a2c36d65edf1ae637b45066d3"
server_key_version: "encryptionkey@0"
I20260808 23:33:20.242535 31222 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.003s
I20260808 23:33:20.246886 31237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:20.248463 31222 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 23:33:20.248709 31222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "58e1dba201db4b7a9fac4bc46cfba9e3"
format_stamp: "Formatted at 2026-08-08 23:33:20 on dist-test-slave-1x4g"
server_key: "f0c8ad91d5c7fee12ec93a71bbae63e6"
server_key_iv: "7417144a2c36d65edf1ae637b45066d3"
server_key_version: "encryptionkey@0"
I20260808 23:33:20.249025 31222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:20.271713 31222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:20.276698 31222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:20.277096 31222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:20.297636 31222 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:44011
I20260808 23:33:20.297660 31291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:44011 every 8 connection(s)
I20260808 23:33:20.299238 31222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:33:20.300657 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 31222
I20260808 23:33:20.301054 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:33:20.301965 27455 external_mini_cluster.cc:1428] Setting key dae287bbffedd4cb04e3105b918449cc
I20260808 23:33:20.304864 31292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 23:33:20 dist-test-slave-1x4g krb5kdc[31207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786231999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:20.319561 31292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3: Bootstrap starting.
I20260808 23:33:20.323374 31292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:20.324564 31292 log.cc:824] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:20.327883 31295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:20.304400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50352 (local address 127.26.207.254:44011)
0808 23:33:20.305352 (+ 952us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:20.305365 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:20.305410 (+ 45us) server_negotiation.cc:407] Connection header received
0808 23:33:20.307191 (+ 1781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:20.307218 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:20.307685 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:20.308093 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:20.310269 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:20.311755 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:20.313579 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:20.314327 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:20.314478 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:20.319518 (+ 5040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:20.319528 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:20.319549 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:20.319601 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:20.323155 (+ 3554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:20.324094 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:20.324102 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:20.324110 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:20.324311 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:20.324761 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:20.324818 (+ 57us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:20.324822 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:20.325519 (+ 697us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:20.325869 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:20.326382 (+ 513us) server_negotiation.cc:299] Negotiation successful
0808 23:33:20.326855 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":729,"thread_start_us":440,"threads_started":1}
I20260808 23:33:20.328011 31292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3: No bootstrap required, opened a new log
I20260808 23:33:20.336542 31292 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e1dba201db4b7a9fac4bc46cfba9e3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44011 } }
I20260808 23:33:20.337186 31292 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:20.337306 31292 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58e1dba201db4b7a9fac4bc46cfba9e3, State: Initialized, Role: FOLLOWER
I20260808 23:33:20.337922 31292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e1dba201db4b7a9fac4bc46cfba9e3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44011 } }
I20260808 23:33:20.338183 31292 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:33:20.338339 31292 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:33:20.338526 31292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:20.341054 31292 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e1dba201db4b7a9fac4bc46cfba9e3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44011 } }
I20260808 23:33:20.341750 31292 leader_election.cc:302] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58e1dba201db4b7a9fac4bc46cfba9e3; no voters:
I20260808 23:33:20.342495 31292 leader_election.cc:288] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:33:20.342602 31297 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:20.343480 31297 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [term 1 LEADER]: Becoming Leader. State: Replica: 58e1dba201db4b7a9fac4bc46cfba9e3, State: Running, Role: LEADER
I20260808 23:33:20.344112 31297 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e1dba201db4b7a9fac4bc46cfba9e3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44011 } }
I20260808 23:33:20.345116 31292 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:33:20.347224 31298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58e1dba201db4b7a9fac4bc46cfba9e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e1dba201db4b7a9fac4bc46cfba9e3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44011 } } }
I20260808 23:33:20.347716 31298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:20.347255 31300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58e1dba201db4b7a9fac4bc46cfba9e3. Latest consensus state: current_term: 1 leader_uuid: "58e1dba201db4b7a9fac4bc46cfba9e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e1dba201db4b7a9fac4bc46cfba9e3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44011 } } }
I20260808 23:33:20.347955 31300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:20.350836 31303 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:33:20.356693 31303 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:33:20.368443 31303 catalog_manager.cc:1347] Generated new cluster ID: cafbe9aad6e54166ad25fa64aa7a2d30
I20260808 23:33:20.368589 31303 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:33:20.400900 31303 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:33:20.402362 31303 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:33:20.412676 31303 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58e1dba201db4b7a9fac4bc46cfba9e3: Generated new TSK 0
I20260808 23:33:20.413750 31303 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:33:20.497006 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:44011
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:20.889389 31319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:20.889724 31319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:20.889828 31319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:20.898864 31319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:20.899055 31319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:20.899187 31319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:33:20.911054 31319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:44011
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:20.912923 31319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:20.914449 31319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:20.930387 31328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:20.930439 31326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:20.930483 31325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:20.931531 31319 server_base.cc:1034] running on GCE node
I20260808 23:33:20.932255 31319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:20.933660 31319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:20.934900 31319 hybrid_clock.cc:648] HybridClock initialized: now 1786232000934822 us; error 74 us; skew 500 ppm
I20260808 23:33:20.935376 31319 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:20 dist-test-slave-1x4g krb5kdc[31207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232000, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:20.939172 31319 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:33:20.941099 31319 webserver.cc:460] Webserver started at http://127.26.207.193:33043/ using document root <none> and password file <none>
I20260808 23:33:20.941901 31319 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:20.942054 31319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:20.942447 31319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:20.946323 31319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "b9ca6adef0c64e1e8f7db249d1150d6d"
format_stamp: "Formatted at 2026-08-08 23:33:20 on dist-test-slave-1x4g"
server_key: "91086d1dddceb199e0502daecddd7cae"
server_key_iv: "58479cb943acb2875cc8ce0ac677e41f"
server_key_version: "encryptionkey@0"
I20260808 23:33:20.947412 31319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "b9ca6adef0c64e1e8f7db249d1150d6d"
format_stamp: "Formatted at 2026-08-08 23:33:20 on dist-test-slave-1x4g"
server_key: "91086d1dddceb199e0502daecddd7cae"
server_key_iv: "58479cb943acb2875cc8ce0ac677e41f"
server_key_version: "encryptionkey@0"
I20260808 23:33:20.955192 31319 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260808 23:33:20.959698 31335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:20.961534 31319 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:33:20.961766 31319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "b9ca6adef0c64e1e8f7db249d1150d6d"
format_stamp: "Formatted at 2026-08-08 23:33:20 on dist-test-slave-1x4g"
server_key: "91086d1dddceb199e0502daecddd7cae"
server_key_iv: "58479cb943acb2875cc8ce0ac677e41f"
server_key_version: "encryptionkey@0"
I20260808 23:33:20.962061 31319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:20.984119 31319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:20.989871 31319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:20.990239 31319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:20.991485 31319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:20.993255 31319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:20.993376 31319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:20.993571 31319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:20.993649 31319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:21.035157 31319 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:46495
I20260808 23:33:21.035238 31457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:46495 every 8 connection(s)
I20260808 23:33:21.036818 31319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:33:21.046558 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 31319
I20260808 23:33:21.046809 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:33:21.047632 27455 external_mini_cluster.cc:1428] Setting key bb224737f7e49bb3ca7a0784e7f75684
Aug 08 23:33:21 dist-test-slave-1x4g krb5kdc[31207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232000, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:21.063412 31460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:21.039882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:44237 (local address 127.26.207.254:44011)
0808 23:33:21.040390 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:21.040395 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:21.041533 (+ 1138us) server_negotiation.cc:407] Connection header received
0808 23:33:21.043538 (+ 2005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:21.043543 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:21.043622 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:21.043751 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:21.045825 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:21.047239 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:21.049413 (+ 2174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:21.050030 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:21.050194 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:21.054498 (+ 4304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:21.054508 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:21.054517 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:21.054576 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:21.058967 (+ 4391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:21.060454 (+ 1487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:21.060459 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:21.060462 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:21.060628 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:21.061311 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:21.061315 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:21.061317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:21.061653 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:21.061787 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:21.062882 (+ 1095us) server_negotiation.cc:299] Negotiation successful
0808 23:33:21.063119 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":267,"threads_started":1}
I20260808 23:33:21.065155 31461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:21.040522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:44011 (local address 127.26.207.193:44237)
0808 23:33:21.041334 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:21.041384 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:21.043182 (+ 1798us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:21.044062 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:21.044098 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:21.044734 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:21.045527 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:21.045550 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:21.047493 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:21.047498 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:21.049241 (+ 1743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:21.049260 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:21.050316 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:21.050323 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:21.050567 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:21.051336 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:21.051366 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:21.054163 (+ 2797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:21.059242 (+ 5079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:21.059283 (+ 41us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:21.059312 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:21.060222 (+ 910us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:21.060771 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:21.060802 (+ 31us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:21.060808 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:21.061132 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:21.061805 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:21.061817 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:21.062384 (+ 567us) client_negotiation.cc:769] Sending connection context
0808 23:33:21.062739 (+ 355us) client_negotiation.cc:240] Negotiation successful
0808 23:33:21.063460 (+ 721us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":332,"threads_started":1}
I20260808 23:33:21.067390 31458 heartbeater.cc:347] Connected to a master server at 127.26.207.254:44011
I20260808 23:33:21.067826 31458 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:21.068728 31458 heartbeater.cc:511] Master 127.26.207.254:44011 requested a full tablet report, sending...
I20260808 23:33:21.071765 31254 ts_manager.cc:194] Registered new tserver with Master: b9ca6adef0c64e1e8f7db249d1150d6d (127.26.207.193:46495)
I20260808 23:33:21.074330 31254 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:44237
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:33:21.114864 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:44011
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:21.490319 31464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:21.490657 31464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:21.490836 31464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:21.498658 31464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:21.498812 31464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:21.499004 31464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:33:21.509477 31464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:44011
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:21.510967 31464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:21.512370 31464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:21.526548 31470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:21.526593 31471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:21.526623 31473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:21.527522 31464 server_base.cc:1034] running on GCE node
I20260808 23:33:21.528206 31464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:21.529393 31464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:21.530642 31464 hybrid_clock.cc:648] HybridClock initialized: now 1786232001530562 us; error 65 us; skew 500 ppm
I20260808 23:33:21.531065 31464 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:21 dist-test-slave-1x4g krb5kdc[31207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232001, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:21.534797 31464 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:33:21.536652 31464 webserver.cc:460] Webserver started at http://127.26.207.194:45387/ using document root <none> and password file <none>
I20260808 23:33:21.537508 31464 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:21.537674 31464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:21.538105 31464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:21.541639 31464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "7a9da9bfc8b2486abe306c244673e661"
format_stamp: "Formatted at 2026-08-08 23:33:21 on dist-test-slave-1x4g"
server_key: "b05e57d1496432707c4bb4f6b1723e5e"
server_key_iv: "9698b6d054e2bc02f3f8def0ebb766bf"
server_key_version: "encryptionkey@0"
I20260808 23:33:21.542640 31464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "7a9da9bfc8b2486abe306c244673e661"
format_stamp: "Formatted at 2026-08-08 23:33:21 on dist-test-slave-1x4g"
server_key: "b05e57d1496432707c4bb4f6b1723e5e"
server_key_iv: "9698b6d054e2bc02f3f8def0ebb766bf"
server_key_version: "encryptionkey@0"
I20260808 23:33:21.548945 31464 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 23:33:21.553568 31480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:21.555383 31464 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 23:33:21.555632 31464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "7a9da9bfc8b2486abe306c244673e661"
format_stamp: "Formatted at 2026-08-08 23:33:21 on dist-test-slave-1x4g"
server_key: "b05e57d1496432707c4bb4f6b1723e5e"
server_key_iv: "9698b6d054e2bc02f3f8def0ebb766bf"
server_key_version: "encryptionkey@0"
I20260808 23:33:21.555913 31464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:21.572618 31464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:21.577654 31464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:21.578025 31464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:21.579144 31464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:21.580678 31464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:21.580788 31464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:21.580981 31464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:21.581068 31464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:21.618523 31464 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:41209
I20260808 23:33:21.618577 31597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:41209 every 8 connection(s)
I20260808 23:33:21.620131 31464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:33:21.624285 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 31464
I20260808 23:33:21.624516 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:33:21.625144 27455 external_mini_cluster.cc:1428] Setting key 9a747dfb634e185a56619edc9b581474
Aug 08 23:33:21 dist-test-slave-1x4g krb5kdc[31207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232001, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:21.643975 31600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:21.623260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:46541 (local address 127.26.207.254:44011)
0808 23:33:21.623870 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:21.623878 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:21.625042 (+ 1164us) server_negotiation.cc:407] Connection header received
0808 23:33:21.627466 (+ 2424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:21.627472 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:21.627576 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:21.627703 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:21.629582 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:21.630363 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:21.632113 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:21.632574 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:21.632721 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:21.636901 (+ 4180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:21.636907 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:21.636911 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:21.636951 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:21.639887 (+ 2936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:21.641131 (+ 1244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:21.641136 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:21.641138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:21.641278 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:21.641900 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:21.641904 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:21.641906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:21.642240 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:21.642360 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:21.643472 (+ 1112us) server_negotiation.cc:299] Negotiation successful
0808 23:33:21.643695 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":336,"threads_started":1}
I20260808 23:33:21.645812 31601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:21.623818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:44011 (local address 127.26.207.194:46541)
0808 23:33:21.624812 (+ 994us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:21.624879 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:21.627120 (+ 2241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:21.627997 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:21.628007 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:21.628618 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:21.629364 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:21.629388 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:21.630571 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:21.630576 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:21.631911 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:21.631927 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:21.632891 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:21.632900 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:21.633164 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:21.633945 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:21.633972 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:21.636452 (+ 2480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:21.640124 (+ 3672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:21.640139 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:21.640163 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:21.640957 (+ 794us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:21.641423 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:21.641431 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:21.641438 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:21.641755 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:21.642388 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:21.642400 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:21.642956 (+ 556us) client_negotiation.cc:769] Sending connection context
0808 23:33:21.643390 (+ 434us) client_negotiation.cc:240] Negotiation successful
0808 23:33:21.644076 (+ 686us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":414,"threads_started":1}
I20260808 23:33:21.647768 31598 heartbeater.cc:347] Connected to a master server at 127.26.207.254:44011
I20260808 23:33:21.648217 31598 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:21.649340 31598 heartbeater.cc:511] Master 127.26.207.254:44011 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
I20260808 23:33:21.651608 31254 ts_manager.cc:194] Registered new tserver with Master: 7a9da9bfc8b2486abe306c244673e661 (127.26.207.194:41209)
I20260808 23:33:21.652516 31254 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:46541
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:33:21.688076 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:44011
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:22.071931 31604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:22.072306 31604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:22.072494 31604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 23:33:22.079015 31458 heartbeater.cc:503] Master 127.26.207.254:44011 was elected leader, sending a full tablet report...
W20260808 23:33:22.080536 31604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:22.080654 31604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:22.080914 31604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:33:22.091387 31604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:44011
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:22.092929 31604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:22.094364 31604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:22.109287 31610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:22.109362 31611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:22.109338 31613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:22.110145 31604 server_base.cc:1034] running on GCE node
I20260808 23:33:22.111054 31604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:22.112165 31604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:22.113406 31604 hybrid_clock.cc:648] HybridClock initialized: now 1786232002113307 us; error 93 us; skew 500 ppm
I20260808 23:33:22.113783 31604 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:22 dist-test-slave-1x4g krb5kdc[31207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232002, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:22.117347 31604 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:33:22.118983 31604 webserver.cc:460] Webserver started at http://127.26.207.195:37837/ using document root <none> and password file <none>
I20260808 23:33:22.119720 31604 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:22.119832 31604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:22.120127 31604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:22.123323 31604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "e2b9ddac9e54498884c8fe803d4c32a7"
format_stamp: "Formatted at 2026-08-08 23:33:22 on dist-test-slave-1x4g"
server_key: "d198b564295c9d6413cb707586293f9a"
server_key_iv: "0d9541d8174f1e935219287bed38af44"
server_key_version: "encryptionkey@0"
I20260808 23:33:22.124274 31604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "e2b9ddac9e54498884c8fe803d4c32a7"
format_stamp: "Formatted at 2026-08-08 23:33:22 on dist-test-slave-1x4g"
server_key: "d198b564295c9d6413cb707586293f9a"
server_key_iv: "0d9541d8174f1e935219287bed38af44"
server_key_version: "encryptionkey@0"
I20260808 23:33:22.131278 31604 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260808 23:33:22.135308 31620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:22.136979 31604 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:33:22.137178 31604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "e2b9ddac9e54498884c8fe803d4c32a7"
format_stamp: "Formatted at 2026-08-08 23:33:22 on dist-test-slave-1x4g"
server_key: "d198b564295c9d6413cb707586293f9a"
server_key_iv: "0d9541d8174f1e935219287bed38af44"
server_key_version: "encryptionkey@0"
I20260808 23:33:22.137388 31604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:22.169448 31604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:22.174599 31604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:22.174885 31604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:22.175907 31604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:22.177477 31604 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:22.177561 31604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:22.177654 31604 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:22.177708 31604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:22.215407 31604 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:36555
I20260808 23:33:22.215473 31740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:36555 every 8 connection(s)
I20260808 23:33:22.216876 31604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:33:22.225472 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 31604
I20260808 23:33:22.225713 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:33:22.226267 27455 external_mini_cluster.cc:1428] Setting key fbb29f4e0376b74e39e15a5fac0315b0
Aug 08 23:33:22 dist-test-slave-1x4g krb5kdc[31207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232002, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:22.239348 31744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:22.219676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:34017 (local address 127.26.207.254:44011)
0808 23:33:22.220206 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:22.220212 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:22.221430 (+ 1218us) server_negotiation.cc:407] Connection header received
0808 23:33:22.223446 (+ 2016us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:22.223453 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:22.223567 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:22.223696 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:22.225500 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:22.226442 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:22.228402 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:22.228920 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:22.229053 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:22.232859 (+ 3806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:22.232866 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:22.232869 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:22.232943 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:22.235759 (+ 2816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:22.236723 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:22.236728 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:22.236730 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:22.236962 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:22.237482 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:22.237486 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:22.237489 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:22.237818 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:22.237953 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:22.238815 (+ 862us) server_negotiation.cc:299] Negotiation successful
0808 23:33:22.239030 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":279,"threads_started":1}
I20260808 23:33:22.240670 31745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:22.220361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:44011 (local address 127.26.207.195:34017)
0808 23:33:22.221241 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:22.221293 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:22.223131 (+ 1838us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:22.223966 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:22.223975 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:22.224547 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:22.225299 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:22.225320 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:22.226623 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:22.226627 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:22.228245 (+ 1618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:22.228258 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:22.229176 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:22.229185 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:22.229426 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:22.230171 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:22.230196 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:22.232544 (+ 2348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:22.235971 (+ 3427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:22.235980 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:22.235999 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:22.236570 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:22.237077 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:22.237100 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:22.237102 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:22.237328 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:22.238015 (+ 687us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:22.238022 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:22.238435 (+ 413us) client_negotiation.cc:769] Sending connection context
0808 23:33:22.238707 (+ 272us) client_negotiation.cc:240] Negotiation successful
0808 23:33:22.239168 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":393,"threads_started":1}
I20260808 23:33:22.242486 31741 heartbeater.cc:347] Connected to a master server at 127.26.207.254:44011
I20260808 23:33:22.242882 31741 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:22.243729 31741 heartbeater.cc:511] Master 127.26.207.254:44011 requested a full tablet report, sending...
I20260808 23:33:22.245471 31254 ts_manager.cc:194] Registered new tserver with Master: e2b9ddac9e54498884c8fe803d4c32a7 (127.26.207.195:36555)
I20260808 23:33:22.246485 31254 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:34017
I20260808 23:33:22.255828 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 23:33:22 dist-test-slave-1x4g krb5kdc[31207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 23:33:22 dist-test-slave-1x4g krb5kdc[31207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:33:22.319792 31750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:22.301229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57704 (local address 127.26.207.193:46495)
0808 23:33:22.302231 (+ 1002us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:22.302242 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:22.302277 (+ 35us) server_negotiation.cc:407] Connection header received
0808 23:33:22.302361 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:22.302371 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:22.302677 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:22.302852 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:22.304482 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:22.306189 (+ 1707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:22.307752 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:22.308404 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:22.308535 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:22.313708 (+ 5173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:22.313726 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:22.313743 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:22.313791 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:22.316837 (+ 3046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:22.317638 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:22.317646 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:22.317657 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:22.317798 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:22.318178 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:22.318181 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:22.318183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:22.318580 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:22.318835 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:22.319083 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 23:33:22.319357 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":811,"thread_start_us":633,"threads_started":1}
Aug 08 23:33:22 dist-test-slave-1x4g krb5kdc[31207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:22.341276 31744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:22.324613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50354 (local address 127.26.207.254:44011)
0808 23:33:22.324886 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:22.324892 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:22.325013 (+ 121us) server_negotiation.cc:407] Connection header received
0808 23:33:22.325174 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:22.325178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:22.325258 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:22.325344 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:22.326902 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:22.327921 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:22.329316 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:22.329779 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:22.329894 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:22.335110 (+ 5216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:22.335116 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:22.335119 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:22.335165 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:22.338254 (+ 3089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:22.339094 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:22.339098 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:22.339100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:22.339251 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:22.339642 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:22.339646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:22.339648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:22.340122 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:22.340328 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:22.340639 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 23:33:22.340911 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260808 23:33:22.341967 31254 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50354
I20260808 23:33:22.343240 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 31319
I20260808 23:33:22.358232 31750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:22.344283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57720 (local address 127.26.207.193:46495)
0808 23:33:22.344555 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:22.344565 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:22.344817 (+ 252us) server_negotiation.cc:407] Connection header received
0808 23:33:22.345060 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:22.345064 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:22.345226 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:22.345317 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:22.346728 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:22.347524 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:22.348890 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:22.349327 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:22.349441 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:22.351934 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:22.351940 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:22.351944 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:22.351984 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:22.355261 (+ 3277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:22.356172 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:22.356178 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:22.356180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:22.356342 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:22.356842 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:22.356847 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:22.356851 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:22.357155 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:22.357350 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:22.357638 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 23:33:22.357834 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 23:33:22.358946 31452 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:22.444898 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 31319
I20260808 23:33:22.467271 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 31464
Aug 08 23:33:22 dist-test-slave-1x4g krb5kdc[31207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:33:22.489813 31755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:22.468346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58154 (local address 127.26.207.194:41209)
0808 23:33:22.468935 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:22.468944 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:22.468972 (+ 28us) server_negotiation.cc:407] Connection header received
0808 23:33:22.469035 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:22.469042 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:22.469267 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:22.469402 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:22.470664 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:22.471740 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:22.473207 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:22.473830 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:22.473954 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:22.483745 (+ 9791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:22.483764 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:22.483780 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:22.483827 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:22.487052 (+ 3225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:22.487791 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:22.487800 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:22.487802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:22.487938 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:22.488322 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:22.488325 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:22.488328 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:22.488686 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:22.489016 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:22.489281 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 23:33:22.489511 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":278,"threads_started":1}
I20260808 23:33:22.491235 31593 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:22.582115 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 31464
I20260808 23:33:22.610980 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 31604
Aug 08 23:33:22 dist-test-slave-1x4g krb5kdc[31207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:33:22.633421 31758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:22.612715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50430 (local address 127.26.207.195:36555)
0808 23:33:22.613975 (+ 1260us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:22.613988 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:22.614035 (+ 47us) server_negotiation.cc:407] Connection header received
0808 23:33:22.614139 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:22.614150 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:22.614491 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:22.614739 (+ 248us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:22.616734 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:22.618808 (+ 2074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:22.620472 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:22.621223 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:22.621389 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:22.626879 (+ 5490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:22.626897 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:22.626914 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:22.626957 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:22.630341 (+ 3384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:22.631177 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:22.631184 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:22.631187 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:22.631323 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:22.631755 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:22.631758 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:22.631760 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:22.632131 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:22.632363 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:22.632681 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 23:33:22.632998 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1020,"thread_start_us":819,"threads_started":1}
I20260808 23:33:22.634948 31736 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:22.722955 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 31604
I20260808 23:33:22.743764 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 31222
I20260808 23:33:22.745215 31287 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:22.856626 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 31222
2026-08-08T23:33:22Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4477 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:33:22 dist-test-slave-1x4g krb5kdc[31764](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:33:22 dist-test-slave-1x4g krb5kdc[31764](info): set up 2 sockets
Aug 08 23:33:22 dist-test-slave-1x4g krb5kdc[31764](info): commencing operation
krb5kdc: starting...
W20260808 23:33:24.021796 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.005s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:33:24 dist-test-slave-1x4g krb5kdc[31764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:33:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:33:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:33:24.293673 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:33895
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:39441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:33895
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:24.657663 31778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:24.657996 31778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:24.658100 31778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:24.665629 31778 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:33:24.665762 31778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:24.665810 31778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:24.665874 31778 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:33:24.665925 31778 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:33:24.676484 31778 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:39441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:33895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:33895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:24.678032 31778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:24.679441 31778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:24.692202 31787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:24.692160 31784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:24.692238 31785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:24.693207 31778 server_base.cc:1034] running on GCE node
I20260808 23:33:24.694201 31778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:24.695811 31778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:24.697101 31778 hybrid_clock.cc:648] HybridClock initialized: now 1786232004697038 us; error 77 us; skew 500 ppm
I20260808 23:33:24.697490 31778 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:24 dist-test-slave-1x4g krb5kdc[31764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232004, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:24.700886 31778 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:33:24.702204 31778 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:24.702358 31778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:24.702728 31778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:24.706298 31778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "e42812938dea4eaf8cc55b3756128110"
format_stamp: "Formatted at 2026-08-08 23:33:24 on dist-test-slave-1x4g"
server_key: "f0844ab01e8cea7c2ef0b89098621fbf"
server_key_iv: "0ce3ca093247042ec5a27e8bb2bb9ece"
server_key_version: "encryptionkey@0"
I20260808 23:33:24.707289 31778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "e42812938dea4eaf8cc55b3756128110"
format_stamp: "Formatted at 2026-08-08 23:33:24 on dist-test-slave-1x4g"
server_key: "f0844ab01e8cea7c2ef0b89098621fbf"
server_key_iv: "0ce3ca093247042ec5a27e8bb2bb9ece"
server_key_version: "encryptionkey@0"
I20260808 23:33:24.713382 31778 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 23:33:24.717532 31793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:24.719266 31778 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:33:24.719612 31778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "e42812938dea4eaf8cc55b3756128110"
format_stamp: "Formatted at 2026-08-08 23:33:24 on dist-test-slave-1x4g"
server_key: "f0844ab01e8cea7c2ef0b89098621fbf"
server_key_iv: "0ce3ca093247042ec5a27e8bb2bb9ece"
server_key_version: "encryptionkey@0"
I20260808 23:33:24.719897 31778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:24.756069 31778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:24.760955 31778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:24.761267 31778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:24.782193 31778 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:33895
I20260808 23:33:24.782159 31847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:33895 every 8 connection(s)
I20260808 23:33:24.783232 31778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:33:24.787323 31848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:24.791932 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 31778
I20260808 23:33:24.792204 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:33:24.793090 27455 external_mini_cluster.cc:1428] Setting key daae609a34a6c05604da92bab2483595
I20260808 23:33:24.800879 31848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110: Bootstrap starting.
I20260808 23:33:24.805158 31848 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:24.806664 31848 log.cc:824] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110: Log is configured to *not* fsync() on all Append() calls
Aug 08 23:33:24 dist-test-slave-1x4g krb5kdc[31764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:24.810688 31848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110: No bootstrap required, opened a new log
I20260808 23:33:24.819932 31848 raft_consensus.cc:348] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42812938dea4eaf8cc55b3756128110" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 33895 } }
I20260808 23:33:24.820525 31848 raft_consensus.cc:374] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:24.820672 31848 raft_consensus.cc:729] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42812938dea4eaf8cc55b3756128110, State: Initialized, Role: FOLLOWER
I20260808 23:33:24.821488 31848 consensus_queue.cc:260] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42812938dea4eaf8cc55b3756128110" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 33895 } }
I20260808 23:33:24.821647 31853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:24.795511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45166 (local address 127.26.207.254:33895)
0808 23:33:24.796405 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:24.796418 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:24.796472 (+ 54us) server_negotiation.cc:407] Connection header received
0808 23:33:24.799022 (+ 2550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:24.799054 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:24.799530 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:24.799915 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:24.802059 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:24.803570 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:24.805625 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:24.806439 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:24.806611 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:24.811909 (+ 5298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:24.811918 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:24.811944 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:24.811994 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:24.816140 (+ 4146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:24.817177 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:24.817185 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:24.817192 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:24.817415 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:24.817930 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:24.817938 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:24.817940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:24.818836 (+ 896us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:24.819228 (+ 392us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:24.819769 (+ 541us) server_negotiation.cc:299] Negotiation successful
0808 23:33:24.820260 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":451,"threads_started":1}
I20260808 23:33:24.821803 31848 raft_consensus.cc:388] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:33:24.821959 31848 raft_consensus.cc:482] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:33:24.822162 31848 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:24.825599 31848 raft_consensus.cc:504] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42812938dea4eaf8cc55b3756128110" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 33895 } }
I20260808 23:33:24.826171 31848 leader_election.cc:302] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e42812938dea4eaf8cc55b3756128110; no voters:
I20260808 23:33:24.826797 31848 leader_election.cc:288] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:33:24.827009 31855 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:24.827832 31855 raft_consensus.cc:686] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [term 1 LEADER]: Becoming Leader. State: Replica: e42812938dea4eaf8cc55b3756128110, State: Running, Role: LEADER
I20260808 23:33:24.828480 31855 consensus_queue.cc:237] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42812938dea4eaf8cc55b3756128110" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 33895 } }
I20260808 23:33:24.835080 31848 sys_catalog.cc:564] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:33:24.839430 31856 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e42812938dea4eaf8cc55b3756128110. Latest consensus state: current_term: 1 leader_uuid: "e42812938dea4eaf8cc55b3756128110" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42812938dea4eaf8cc55b3756128110" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 33895 } } }
I20260808 23:33:24.839883 31856 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:24.840765 31857 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e42812938dea4eaf8cc55b3756128110" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42812938dea4eaf8cc55b3756128110" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 33895 } } }
I20260808 23:33:24.841173 31857 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:24.842360 31862 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:33:24.848889 31862 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:33:24.859882 31862 catalog_manager.cc:1347] Generated new cluster ID: 347011f7b67246158e3e9b920f8296d0
I20260808 23:33:24.860039 31862 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:33:24.900382 31862 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:33:24.902593 31862 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:33:24.912926 31862 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110: Generated new TSK 0
I20260808 23:33:24.913928 31862 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:33:24.984838 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:33895
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:39441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:25.363912 31878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:25.364245 31878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:25.364428 31878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:25.372272 31878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:25.372419 31878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:25.372632 31878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:33:25.383448 31878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:39441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:33895
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:25.385039 31878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:25.386530 31878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:25.401417 31883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:25.401444 31884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:25.401479 31886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:25.402637 31878 server_base.cc:1034] running on GCE node
I20260808 23:33:25.403378 31878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:25.404522 31878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:25.405807 31878 hybrid_clock.cc:648] HybridClock initialized: now 1786232005405731 us; error 71 us; skew 500 ppm
I20260808 23:33:25.406231 31878 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:25 dist-test-slave-1x4g krb5kdc[31764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232005, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:25.413802 31878 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:33:25.415408 31878 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:25.415601 31878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:25.415939 31878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:25.419569 31878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "96f585b22bcc47249bdd4f3675aebb5e"
format_stamp: "Formatted at 2026-08-08 23:33:25 on dist-test-slave-1x4g"
server_key: "fac91d9a1ed6de54de760b76d509be56"
server_key_iv: "e8b760bbdb229139a41b0b7fdb429b3c"
server_key_version: "encryptionkey@0"
I20260808 23:33:25.420531 31878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "96f585b22bcc47249bdd4f3675aebb5e"
format_stamp: "Formatted at 2026-08-08 23:33:25 on dist-test-slave-1x4g"
server_key: "fac91d9a1ed6de54de760b76d509be56"
server_key_iv: "e8b760bbdb229139a41b0b7fdb429b3c"
server_key_version: "encryptionkey@0"
I20260808 23:33:25.427058 31878 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.001s
I20260808 23:33:25.431205 31894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:25.432902 31878 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:33:25.433117 31878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "96f585b22bcc47249bdd4f3675aebb5e"
format_stamp: "Formatted at 2026-08-08 23:33:25 on dist-test-slave-1x4g"
server_key: "fac91d9a1ed6de54de760b76d509be56"
server_key_iv: "e8b760bbdb229139a41b0b7fdb429b3c"
server_key_version: "encryptionkey@0"
I20260808 23:33:25.433372 31878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:25.458212 31878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:25.463562 31878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:25.463937 31878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:25.465209 31878 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:25.466841 31878 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:25.466948 31878 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:25.467119 31878 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:25.467211 31878 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:25.504853 31878 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:38157
I20260808 23:33:25.504966 32016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:38157 every 8 connection(s)
I20260808 23:33:25.505944 31878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:33:25.513247 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 31878
I20260808 23:33:25.513506 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:33:25.514182 27455 external_mini_cluster.cc:1428] Setting key d0e337b034fcf47ef45c215cff23947c
Aug 08 23:33:25 dist-test-slave-1x4g krb5kdc[31764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232005, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:25.529644 32019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:25.508764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:37323 (local address 127.26.207.254:33895)
0808 23:33:25.509345 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:25.509350 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:25.510292 (+ 942us) server_negotiation.cc:407] Connection header received
0808 23:33:25.512263 (+ 1971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:25.512268 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:25.512371 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:25.512501 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:25.514483 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:25.515544 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:25.517610 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:25.518039 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:25.518186 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:25.522194 (+ 4008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:25.522200 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:25.522203 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:25.522241 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:25.525675 (+ 3434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:25.526935 (+ 1260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:25.526940 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:25.526942 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:25.527098 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:25.527641 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:25.527644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:25.527646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:25.527945 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:25.528081 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:25.529150 (+ 1069us) server_negotiation.cc:299] Negotiation successful
0808 23:33:25.529358 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":282,"threads_started":1}
I20260808 23:33:25.531422 32021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:25.509310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:33895 (local address 127.26.207.193:37323)
0808 23:33:25.510104 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:25.510155 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:25.511929 (+ 1774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:25.512855 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:25.512866 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:25.513573 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:25.514272 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:25.514303 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:25.515733 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:25.515737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:25.517409 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:25.517427 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:25.518320 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:25.518327 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:25.518583 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:25.519363 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:25.519388 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:25.521880 (+ 2492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:25.525885 (+ 4005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:25.525900 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:25.525928 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:25.526777 (+ 849us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:25.527220 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:25.527228 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:25.527235 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:25.527513 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:25.528104 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:25.528117 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:25.528653 (+ 536us) client_negotiation.cc:769] Sending connection context
0808 23:33:25.529026 (+ 373us) client_negotiation.cc:240] Negotiation successful
0808 23:33:25.529778 (+ 752us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":306,"threads_started":1}
I20260808 23:33:25.533572 32017 heartbeater.cc:347] Connected to a master server at 127.26.207.254:33895
I20260808 23:33:25.533943 32017 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:25.534723 32017 heartbeater.cc:511] Master 127.26.207.254:33895 requested a full tablet report, sending...
I20260808 23:33:25.537499 31811 ts_manager.cc:194] Registered new tserver with Master: 96f585b22bcc47249bdd4f3675aebb5e (127.26.207.193:38157)
I20260808 23:33:25.539196 31811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:37323
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:33:25.577750 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:33895
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:39441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:25.937474 32025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:25.937798 32025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:25.938009 32025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:25.945854 32025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:25.945990 32025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:25.946189 32025 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:33:25.956881 32025 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:39441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:33895
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:25.958424 32025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:25.959839 32025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:25.974081 32030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:25.974148 32033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:25.974171 32031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:25.975503 32025 server_base.cc:1034] running on GCE node
I20260808 23:33:25.976270 32025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:25.977488 32025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:25.978730 32025 hybrid_clock.cc:648] HybridClock initialized: now 1786232005978664 us; error 64 us; skew 500 ppm
I20260808 23:33:25.979058 32025 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:25 dist-test-slave-1x4g krb5kdc[31764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232005, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:25.982865 32025 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:33:25.984278 32025 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:25.984387 32025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:25.984758 32025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:25.988122 32025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "59a16e44ba584c949ca693529fcc43ae"
format_stamp: "Formatted at 2026-08-08 23:33:25 on dist-test-slave-1x4g"
server_key: "92dfb1323e67773f4786d60ac695856a"
server_key_iv: "9ae438a31a7dc526c7b640e885e84ba4"
server_key_version: "encryptionkey@0"
I20260808 23:33:25.989177 32025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "59a16e44ba584c949ca693529fcc43ae"
format_stamp: "Formatted at 2026-08-08 23:33:25 on dist-test-slave-1x4g"
server_key: "92dfb1323e67773f4786d60ac695856a"
server_key_iv: "9ae438a31a7dc526c7b640e885e84ba4"
server_key_version: "encryptionkey@0"
I20260808 23:33:25.995051 32025 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 23:33:25.999191 32039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:26.000712 32025 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 23:33:26.000957 32025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "59a16e44ba584c949ca693529fcc43ae"
format_stamp: "Formatted at 2026-08-08 23:33:25 on dist-test-slave-1x4g"
server_key: "92dfb1323e67773f4786d60ac695856a"
server_key_iv: "9ae438a31a7dc526c7b640e885e84ba4"
server_key_version: "encryptionkey@0"
I20260808 23:33:26.001248 32025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:26.014919 32025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:26.019757 32025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:26.020085 32025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:26.021243 32025 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:26.022892 32025 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:26.023053 32025 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:26.023190 32025 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:26.023288 32025 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:26.059581 32025 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:33855
I20260808 23:33:26.059644 32155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:33855 every 8 connection(s)
I20260808 23:33:26.060588 32025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:33:26.065321 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 32025
I20260808 23:33:26.065555 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:33:26.066124 27455 external_mini_cluster.cc:1428] Setting key b8f59b18144d5d156dacfc20ecbfaf40
Aug 08 23:33:26 dist-test-slave-1x4g krb5kdc[31764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232005, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:26.087419 32158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:26.063351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:53279 (local address 127.26.207.254:33895)
0808 23:33:26.063830 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:26.063835 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:26.065005 (+ 1170us) server_negotiation.cc:407] Connection header received
0808 23:33:26.067597 (+ 2592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:26.067602 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:26.067681 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:26.067799 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:26.070119 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.070872 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.073585 (+ 2713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.074051 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.074156 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:26.079194 (+ 5038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:26.079204 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:26.079211 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:26.079267 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:26.083372 (+ 4105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:26.084414 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:26.084423 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:26.084429 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:26.084611 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:26.085176 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:26.085184 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:26.085190 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:26.085633 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:26.085797 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:26.086599 (+ 802us) server_negotiation.cc:299] Negotiation successful
0808 23:33:26.086895 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":241,"threads_started":1}
I20260808 23:33:26.088124 32159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:26.063966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:33895 (local address 127.26.207.194:53279)
0808 23:33:26.064730 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:26.064772 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:26.067292 (+ 2520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:26.068076 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:26.068093 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:26.068947 (+ 854us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:26.069874 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:26.069907 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.071077 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.071086 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:26.073394 (+ 2308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:26.073416 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.074321 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.074332 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:26.074677 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:26.075553 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:26.075599 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:26.078831 (+ 3232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:26.083628 (+ 4797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:26.083638 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:26.083664 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:26.084230 (+ 566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:26.084741 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:26.084745 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:26.084747 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:26.085035 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:26.085772 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:26.085780 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:26.086172 (+ 392us) client_negotiation.cc:769] Sending connection context
0808 23:33:26.086441 (+ 269us) client_negotiation.cc:240] Negotiation successful
0808 23:33:26.086884 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":298,"threads_started":1}
I20260808 23:33:26.089982 32156 heartbeater.cc:347] Connected to a master server at 127.26.207.254:33895
I20260808 23:33:26.090412 32156 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:26.091416 32156 heartbeater.cc:511] Master 127.26.207.254:33895 requested a full tablet report, sending...
I20260808 23:33:26.093328 31811 ts_manager.cc:194] Registered new tserver with Master: 59a16e44ba584c949ca693529fcc43ae (127.26.207.194:33855)
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
I20260808 23:33:26.094241 31811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:53279
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:33:26.129364 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:33895
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:39441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:26.494892 32162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:26.495286 32162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:26.495398 32162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:26.503095 32162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:26.503237 32162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:26.503366 32162 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:33:26.514091 32162 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:39441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:33895
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:26.515515 32162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:26.517031 32162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:26.531172 32168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:26.531201 32167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:26.531112 32170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:26.532091 32162 server_base.cc:1034] running on GCE node
I20260808 23:33:26.532720 32162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:26.533842 32162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:26.535060 32162 hybrid_clock.cc:648] HybridClock initialized: now 1786232006535014 us; error 42 us; skew 500 ppm
I20260808 23:33:26.535427 32162 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:26 dist-test-slave-1x4g krb5kdc[31764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232006, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:26.539398 32162 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:33:26.540737 32162 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:26.540915 32162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:26.541237 32162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:26.542980 32017 heartbeater.cc:503] Master 127.26.207.254:33895 was elected leader, sending a full tablet report...
I20260808 23:33:26.544987 32162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "649d833cf66e428ea0cbac1b99339123"
format_stamp: "Formatted at 2026-08-08 23:33:26 on dist-test-slave-1x4g"
server_key: "782d5f626cf797270d31a651b5f84cdb"
server_key_iv: "d9e06b0c7d825747d6f31f0e27fd5518"
server_key_version: "encryptionkey@0"
I20260808 23:33:26.545921 32162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "649d833cf66e428ea0cbac1b99339123"
format_stamp: "Formatted at 2026-08-08 23:33:26 on dist-test-slave-1x4g"
server_key: "782d5f626cf797270d31a651b5f84cdb"
server_key_iv: "d9e06b0c7d825747d6f31f0e27fd5518"
server_key_version: "encryptionkey@0"
I20260808 23:33:26.551954 32162 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 23:33:26.556141 32176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:26.557798 32162 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:33:26.558027 32162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "649d833cf66e428ea0cbac1b99339123"
format_stamp: "Formatted at 2026-08-08 23:33:26 on dist-test-slave-1x4g"
server_key: "782d5f626cf797270d31a651b5f84cdb"
server_key_iv: "d9e06b0c7d825747d6f31f0e27fd5518"
server_key_version: "encryptionkey@0"
I20260808 23:33:26.558306 32162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:26.576772 32162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:26.582268 32162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:26.582620 32162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:26.583748 32162 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:26.585389 32162 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:26.585539 32162 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:26.585680 32162 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:26.585777 32162 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:26.623648 32162 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:40475
I20260808 23:33:26.623718 32293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:40475 every 8 connection(s)
I20260808 23:33:26.624676 32162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:33:26.628226 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 32162
I20260808 23:33:26.628459 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:33:26.629112 27455 external_mini_cluster.cc:1428] Setting key 5207754846ddbd0d271b8c7b9fd266f1
Aug 08 23:33:26 dist-test-slave-1x4g krb5kdc[31764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232006, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:26.657711 32296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:26.627539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:43743 (local address 127.26.207.254:33895)
0808 23:33:26.628528 (+ 989us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:26.628537 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:26.629516 (+ 979us) server_negotiation.cc:407] Connection header received
0808 23:33:26.631962 (+ 2446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:26.631966 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:26.632076 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:26.632165 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:26.634079 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.634937 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.646220 (+ 11283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.646706 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.646864 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:26.650820 (+ 3956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:26.650826 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:26.650829 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:26.650867 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:26.653771 (+ 2904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:26.654649 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:26.654655 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:26.654658 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:26.654800 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:26.655356 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:26.655361 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:26.655365 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:26.655694 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:26.655858 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:26.657030 (+ 1172us) server_negotiation.cc:299] Negotiation successful
0808 23:33:26.657316 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":819,"thread_start_us":648,"threads_started":1}
I20260808 23:33:26.658844 32297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:26.628334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:33895 (local address 127.26.207.195:43743)
0808 23:33:26.629273 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:26.629343 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:26.631617 (+ 2274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:26.632486 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:26.632496 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:26.633223 (+ 727us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:26.633866 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:26.633892 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.635111 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.635115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:26.646027 (+ 10912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:26.646056 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.646985 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.646993 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:26.647249 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:26.648041 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:26.648068 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:26.650531 (+ 2463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:26.653971 (+ 3440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:26.653982 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:26.654002 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:26.654504 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:26.655001 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:26.655006 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:26.655010 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:26.655225 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:26.655837 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:26.655845 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:26.656291 (+ 446us) client_negotiation.cc:769] Sending connection context
0808 23:33:26.656672 (+ 381us) client_negotiation.cc:240] Negotiation successful
0808 23:33:26.657316 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":385,"threads_started":1}
I20260808 23:33:26.660481 32294 heartbeater.cc:347] Connected to a master server at 127.26.207.254:33895
I20260808 23:33:26.660900 32294 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:26.661723 32294 heartbeater.cc:511] Master 127.26.207.254:33895 requested a full tablet report, sending...
I20260808 23:33:26.663497 31811 ts_manager.cc:194] Registered new tserver with Master: 649d833cf66e428ea0cbac1b99339123 (127.26.207.195:40475)
I20260808 23:33:26.664381 31811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:43743
I20260808 23:33:26.672529 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:33:26.697469 32296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:26.679957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45174 (local address 127.26.207.254:33895)
0808 23:33:26.680220 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:26.680230 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:26.680856 (+ 626us) server_negotiation.cc:407] Connection header received
0808 23:33:26.681084 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:26.681092 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:26.681230 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:26.681378 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:26.682913 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.684284 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.685803 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.686590 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.686772 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:26.689323 (+ 2551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:26.689333 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:26.689341 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:26.689401 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:26.693799 (+ 4398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:26.694767 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:26.694777 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:26.694782 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:26.694969 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:26.695381 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:26.695389 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:26.695395 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:26.696000 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:26.696312 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:26.696629 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 23:33:26.696990 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 23:33:26.702984 31811 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45174:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:33:26.717254 31811 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:33:26.756966 32308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:26.734913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:40475 (local address 127.0.0.1:59548)
0808 23:33:26.739620 (+ 4707us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:26.739672 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:26.739896 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:26.747903 (+ 8007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:26.747917 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:26.747986 (+ 69us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:26.748554 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:26.748575 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.750879 (+ 2304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.750885 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:26.753548 (+ 2663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:26.753567 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.755828 (+ 2261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.755835 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:26.756087 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:26.756147 (+ 60us) client_negotiation.cc:769] Sending connection context
0808 23:33:26.756265 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 23:33:26.756497 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4415,"thread_start_us":15380,"threads_started":1}
I20260808 23:33:26.758524 32309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:26.735341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59548 (local address 127.26.207.195:40475)
0808 23:33:26.746830 (+ 11489us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:26.746845 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:26.746919 (+ 74us) server_negotiation.cc:407] Connection header received
0808 23:33:26.747080 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:26.747094 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:26.747514 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:26.747839 (+ 325us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:26.748972 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.750718 (+ 1746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.753833 (+ 3115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.755569 (+ 1736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.757602 (+ 2033us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:26.757827 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:26.757921 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 23:33:26.758119 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11196,"thread_start_us":12816,"threads_started":1}
I20260808 23:33:26.759750 32307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:26.735327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:38157 (local address 127.0.0.1:58776)
0808 23:33:26.750233 (+ 14906us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:26.750255 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:26.750492 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:26.751748 (+ 1256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:26.751754 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:26.751782 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:26.752204 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:26.752216 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.754294 (+ 2078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.754301 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:26.756404 (+ 2103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:26.756419 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.758857 (+ 2438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.758863 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:26.759054 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:26.759080 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 23:33:26.759203 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 23:33:26.759348 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14770,"thread_start_us":3824,"threads_started":1}
I20260808 23:33:26.764110 32226 tablet_service.cc:1467] Processing CreateTablet for tablet 4bf0b4b9cdfa4cb5b8f8ff446db4791c (DEFAULT_TABLE table=test-table [id=d73a5c865c3743c0bac9d3050f92eb73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:26.765717 32226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bf0b4b9cdfa4cb5b8f8ff446db4791c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:26.769646 32310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:26.736110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58776 (local address 127.26.207.193:38157)
0808 23:33:26.749602 (+ 13492us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:26.749613 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:26.750360 (+ 747us) server_negotiation.cc:407] Connection header received
0808 23:33:26.750702 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:26.750710 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:26.751127 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:26.751329 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:26.752460 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.754059 (+ 1599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.756629 (+ 2570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.758238 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.758433 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:26.758642 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:26.769033 (+ 10391us) server_negotiation.cc:299] Negotiation successful
0808 23:33:26.769264 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13248,"thread_start_us":13500,"threads_started":1}
I20260808 23:33:26.770316 32308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:26.759152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:33855 (local address 127.0.0.1:43364)
0808 23:33:26.759325 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:26.759345 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:26.759453 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:26.761824 (+ 2371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:26.761829 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:26.761861 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:26.762048 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:26.762059 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.764596 (+ 2537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.764605 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:26.766983 (+ 2378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:26.767008 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.769504 (+ 2496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.769510 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:26.769756 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:26.769807 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 23:33:26.769881 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 23:33:26.770037 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 23:33:26.771657 32311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:26.751246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43364 (local address 127.26.207.194:33855)
0808 23:33:26.760758 (+ 9512us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:26.760766 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:26.760831 (+ 65us) server_negotiation.cc:407] Connection header received
0808 23:33:26.760993 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:26.761002 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:26.761576 (+ 574us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:26.762368 (+ 792us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:26.762745 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.764383 (+ 1638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.767228 (+ 2845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:26.769261 (+ 2033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:26.770489 (+ 1228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:26.770739 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:26.770841 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 23:33:26.771071 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9316,"thread_start_us":8987,"threads_started":1}
I20260808 23:33:26.774722 31943 tablet_service.cc:1467] Processing CreateTablet for tablet 4bf0b4b9cdfa4cb5b8f8ff446db4791c (DEFAULT_TABLE table=test-table [id=d73a5c865c3743c0bac9d3050f92eb73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:26.776769 31943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bf0b4b9cdfa4cb5b8f8ff446db4791c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:26.776676 32089 tablet_service.cc:1467] Processing CreateTablet for tablet 4bf0b4b9cdfa4cb5b8f8ff446db4791c (DEFAULT_TABLE table=test-table [id=d73a5c865c3743c0bac9d3050f92eb73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:26.780705 32089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bf0b4b9cdfa4cb5b8f8ff446db4791c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:26.800105 32313 tablet_bootstrap.cc:492] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e: Bootstrap starting.
I20260808 23:33:26.806701 32313 tablet_bootstrap.cc:654] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:26.808303 32313 log.cc:824] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:26.809952 32314 tablet_bootstrap.cc:492] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123: Bootstrap starting.
I20260808 23:33:26.817265 32314 tablet_bootstrap.cc:654] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:26.818640 32313 tablet_bootstrap.cc:492] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e: No bootstrap required, opened a new log
I20260808 23:33:26.819039 32313 ts_tablet_manager.cc:1397] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.000s
I20260808 23:33:26.822032 32316 tablet_bootstrap.cc:492] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae: Bootstrap starting.
I20260808 23:33:26.823864 32314 log.cc:824] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:26.834383 32313 raft_consensus.cc:348] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649d833cf66e428ea0cbac1b99339123" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40475 } } peers { permanent_uuid: "96f585b22bcc47249bdd4f3675aebb5e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38157 } } peers { permanent_uuid: "59a16e44ba584c949ca693529fcc43ae" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33855 } }
I20260808 23:33:26.835364 32313 raft_consensus.cc:374] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:26.835624 32316 tablet_bootstrap.cc:654] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:26.835659 32313 raft_consensus.cc:729] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96f585b22bcc47249bdd4f3675aebb5e, State: Initialized, Role: FOLLOWER
I20260808 23:33:26.837412 32313 consensus_queue.cc:260] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649d833cf66e428ea0cbac1b99339123" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40475 } } peers { permanent_uuid: "96f585b22bcc47249bdd4f3675aebb5e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38157 } } peers { permanent_uuid: "59a16e44ba584c949ca693529fcc43ae" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33855 } }
I20260808 23:33:26.838423 32316 log.cc:824] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:26.838616 32314 tablet_bootstrap.cc:492] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123: No bootstrap required, opened a new log
I20260808 23:33:26.839028 32314 ts_tablet_manager.cc:1397] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.017s
I20260808 23:33:26.851111 32316 tablet_bootstrap.cc:492] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae: No bootstrap required, opened a new log
I20260808 23:33:26.851702 32316 ts_tablet_manager.cc:1397] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae: Time spent bootstrapping tablet: real 0.030s user 0.010s sys 0.008s
I20260808 23:33:26.853354 32313 ts_tablet_manager.cc:1428] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e: Time spent starting tablet: real 0.034s user 0.018s sys 0.013s
I20260808 23:33:26.856769 32314 raft_consensus.cc:348] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649d833cf66e428ea0cbac1b99339123" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40475 } } peers { permanent_uuid: "96f585b22bcc47249bdd4f3675aebb5e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38157 } } peers { permanent_uuid: "59a16e44ba584c949ca693529fcc43ae" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33855 } }
I20260808 23:33:26.857371 32314 raft_consensus.cc:374] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:26.857486 32314 raft_consensus.cc:729] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 649d833cf66e428ea0cbac1b99339123, State: Initialized, Role: FOLLOWER
I20260808 23:33:26.859055 32314 consensus_queue.cc:260] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649d833cf66e428ea0cbac1b99339123" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40475 } } peers { permanent_uuid: "96f585b22bcc47249bdd4f3675aebb5e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38157 } } peers { permanent_uuid: "59a16e44ba584c949ca693529fcc43ae" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33855 } }
I20260808 23:33:26.861689 32294 heartbeater.cc:503] Master 127.26.207.254:33895 was elected leader, sending a full tablet report...
I20260808 23:33:26.862351 32314 ts_tablet_manager.cc:1428] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123: Time spent starting tablet: real 0.023s user 0.017s sys 0.003s
I20260808 23:33:26.868330 32316 raft_consensus.cc:348] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649d833cf66e428ea0cbac1b99339123" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40475 } } peers { permanent_uuid: "96f585b22bcc47249bdd4f3675aebb5e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38157 } } peers { permanent_uuid: "59a16e44ba584c949ca693529fcc43ae" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33855 } }
I20260808 23:33:26.868986 32316 raft_consensus.cc:374] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:26.869122 32316 raft_consensus.cc:729] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59a16e44ba584c949ca693529fcc43ae, State: Initialized, Role: FOLLOWER
I20260808 23:33:26.869935 32316 consensus_queue.cc:260] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649d833cf66e428ea0cbac1b99339123" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40475 } } peers { permanent_uuid: "96f585b22bcc47249bdd4f3675aebb5e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38157 } } peers { permanent_uuid: "59a16e44ba584c949ca693529fcc43ae" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33855 } }
I20260808 23:33:26.871317 32156 heartbeater.cc:503] Master 127.26.207.254:33895 was elected leader, sending a full tablet report...
I20260808 23:33:26.872308 32316 ts_tablet_manager.cc:1428] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae: Time spent starting tablet: real 0.020s user 0.018s sys 0.000s
W20260808 23:33:26.876543 32295 tablet.cc:2369] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:33:27.008716 32018 tablet.cc:2369] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:33:27.039705 32319 raft_consensus.cc:482] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:33:27.040050 32319 raft_consensus.cc:504] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649d833cf66e428ea0cbac1b99339123" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40475 } } peers { permanent_uuid: "96f585b22bcc47249bdd4f3675aebb5e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38157 } } peers { permanent_uuid: "59a16e44ba584c949ca693529fcc43ae" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33855 } }
I20260808 23:33:27.042009 32319 leader_election.cc:288] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 649d833cf66e428ea0cbac1b99339123 (127.26.207.195:40475), 59a16e44ba584c949ca693529fcc43ae (127.26.207.194:33855)
I20260808 23:33:27.051522 32309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:27.042550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:44125 (local address 127.26.207.195:40475)
0808 23:33:27.042772 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:27.042777 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:27.043094 (+ 317us) server_negotiation.cc:407] Connection header received
0808 23:33:27.043380 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:27.043387 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:27.043483 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:27.043740 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:27.044530 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:27.045731 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:27.048825 (+ 3094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:27.050216 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:27.050410 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:27.050503 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:27.051071 (+ 568us) server_negotiation.cc:299] Negotiation successful
0808 23:33:27.051224 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 23:33:27.051527 32311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:27.043474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:47363 (local address 127.26.207.194:33855)
0808 23:33:27.043780 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:27.043786 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:27.043930 (+ 144us) server_negotiation.cc:407] Connection header received
0808 23:33:27.044098 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:27.044103 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:27.044169 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:27.044257 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:27.044878 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:27.045989 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:27.048827 (+ 2838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:27.050197 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:27.050410 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:27.050503 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:27.051071 (+ 568us) server_negotiation.cc:299] Negotiation successful
0808 23:33:27.051223 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
I20260808 23:33:27.051736 32324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:27.043145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:33855 (local address 127.26.207.193:47363)
0808 23:33:27.043822 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:27.043839 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:27.043966 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:27.044314 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:27.044320 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:27.044350 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:27.044694 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:27.044702 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:27.046143 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:27.046148 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:27.048549 (+ 2401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:27.048570 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:27.050556 (+ 1986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:27.050561 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:27.050838 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:27.050906 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 23:33:27.051017 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 23:33:27.051213 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"mutex_wait_us":127,"thread_start_us":346,"threads_started":1}
I20260808 23:33:27.051918 32323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:27.042249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:40475 (local address 127.26.207.193:44125)
0808 23:33:27.042994 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:27.043019 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:27.043187 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:27.043824 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:27.043830 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:27.043867 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:27.044351 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:27.044362 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:27.045886 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:27.045890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:27.048549 (+ 2659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:27.048570 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:27.050543 (+ 1973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:27.050550 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:27.050853 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:27.050915 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 23:33:27.051017 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 23:33:27.051212 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"mutex_wait_us":245,"spinlock_wait_cycles":12544,"thread_start_us":380,"threads_started":1}
I20260808 23:33:27.053092 32109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf0b4b9cdfa4cb5b8f8ff446db4791c" candidate_uuid: "96f585b22bcc47249bdd4f3675aebb5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59a16e44ba584c949ca693529fcc43ae" is_pre_election: true
I20260808 23:33:27.053229 32246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf0b4b9cdfa4cb5b8f8ff446db4791c" candidate_uuid: "96f585b22bcc47249bdd4f3675aebb5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "649d833cf66e428ea0cbac1b99339123" is_pre_election: true
I20260808 23:33:27.053680 32109 raft_consensus.cc:2454] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96f585b22bcc47249bdd4f3675aebb5e in term 0.
I20260808 23:33:27.053759 32246 raft_consensus.cc:2454] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96f585b22bcc47249bdd4f3675aebb5e in term 0.
I20260808 23:33:27.054478 31895 leader_election.cc:302] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59a16e44ba584c949ca693529fcc43ae, 96f585b22bcc47249bdd4f3675aebb5e; no voters:
I20260808 23:33:27.054932 32319 raft_consensus.cc:2781] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:33:27.055102 32319 raft_consensus.cc:482] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:33:27.055219 32319 raft_consensus.cc:3037] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:27.057632 32319 raft_consensus.cc:504] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649d833cf66e428ea0cbac1b99339123" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40475 } } peers { permanent_uuid: "96f585b22bcc47249bdd4f3675aebb5e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38157 } } peers { permanent_uuid: "59a16e44ba584c949ca693529fcc43ae" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33855 } }
I20260808 23:33:27.058307 32319 leader_election.cc:288] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [CANDIDATE]: Term 1 election: Requested vote from peers 649d833cf66e428ea0cbac1b99339123 (127.26.207.195:40475), 59a16e44ba584c949ca693529fcc43ae (127.26.207.194:33855)
I20260808 23:33:27.058923 32109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf0b4b9cdfa4cb5b8f8ff446db4791c" candidate_uuid: "96f585b22bcc47249bdd4f3675aebb5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59a16e44ba584c949ca693529fcc43ae"
I20260808 23:33:27.058977 32246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf0b4b9cdfa4cb5b8f8ff446db4791c" candidate_uuid: "96f585b22bcc47249bdd4f3675aebb5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "649d833cf66e428ea0cbac1b99339123"
I20260808 23:33:27.059221 32109 raft_consensus.cc:3037] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:27.059234 32246 raft_consensus.cc:3037] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:27.061949 32109 raft_consensus.cc:2454] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96f585b22bcc47249bdd4f3675aebb5e in term 1.
I20260808 23:33:27.062538 31895 leader_election.cc:302] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59a16e44ba584c949ca693529fcc43ae, 96f585b22bcc47249bdd4f3675aebb5e; no voters:
W20260808 23:33:27.062791 32157 tablet.cc:2369] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:33:27.062932 32319 raft_consensus.cc:2781] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:27.062958 32246 raft_consensus.cc:2454] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96f585b22bcc47249bdd4f3675aebb5e in term 1.
I20260808 23:33:27.064009 32319 raft_consensus.cc:686] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [term 1 LEADER]: Becoming Leader. State: Replica: 96f585b22bcc47249bdd4f3675aebb5e, State: Running, Role: LEADER
I20260808 23:33:27.064654 32319 consensus_queue.cc:237] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649d833cf66e428ea0cbac1b99339123" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40475 } } peers { permanent_uuid: "96f585b22bcc47249bdd4f3675aebb5e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38157 } } peers { permanent_uuid: "59a16e44ba584c949ca693529fcc43ae" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33855 } }
I20260808 23:33:27.069697 31810 catalog_manager.cc:5495] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 96f585b22bcc47249bdd4f3675aebb5e (127.26.207.193). New cstate: current_term: 1 leader_uuid: "96f585b22bcc47249bdd4f3675aebb5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649d833cf66e428ea0cbac1b99339123" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96f585b22bcc47249bdd4f3675aebb5e" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59a16e44ba584c949ca693529fcc43ae" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33855 } health_report { overall_health: UNKNOWN } } }
I20260808 23:33:27.120539 32310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:27.115124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58786 (local address 127.26.207.193:38157)
0808 23:33:27.115319 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:27.115324 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:27.115378 (+ 54us) server_negotiation.cc:407] Connection header received
0808 23:33:27.115590 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:27.115594 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:27.115686 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:27.115819 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:27.116229 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:27.116993 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:27.118407 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:27.118825 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:27.118925 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:27.119457 (+ 532us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:27.119990 (+ 533us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:27.120135 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:27.120239 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 23:33:27.120324 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 23:33:27.130052 32109 raft_consensus.cc:1261] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae [term 1 FOLLOWER]: Refusing update from remote peer 96f585b22bcc47249bdd4f3675aebb5e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:27.130038 32246 raft_consensus.cc:1261] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123 [term 1 FOLLOWER]: Refusing update from remote peer 96f585b22bcc47249bdd4f3675aebb5e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:27.131266 32325 consensus_queue.cc:1035] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "59a16e44ba584c949ca693529fcc43ae" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:27.131667 32319 consensus_queue.cc:1035] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "649d833cf66e428ea0cbac1b99339123" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:27.149974 32329 mvcc.cc:205] Tried to move back new op lower bound from 7316406301192568832 to 7316406300941660160. Current Snapshot: MvccSnapshot[applied={T|T < 7316406301192568832 or (T in {7316406301192568832})}]
I20260808 23:33:27.166472 31810 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:27.166812 31810 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:27.170854 31810 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e42812938dea4eaf8cc55b3756128110: Sending DeleteTablet for 3 replicas of tablet 4bf0b4b9cdfa4cb5b8f8ff446db4791c
I20260808 23:33:27.172454 31943 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bf0b4b9cdfa4cb5b8f8ff446db4791c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:27 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:58776
I20260808 23:33:27.172590 32226 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bf0b4b9cdfa4cb5b8f8ff446db4791c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:27 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:59548
I20260808 23:33:27.172577 32089 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bf0b4b9cdfa4cb5b8f8ff446db4791c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:27 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:43364
I20260808 23:33:27.180384 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 31878
I20260808 23:33:27.188380 32339 tablet_replica.cc:330] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e: stopping tablet replica
I20260808 23:33:27.188880 32341 tablet_replica.cc:330] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae: stopping tablet replica
I20260808 23:33:27.189106 32339 raft_consensus.cc:2229] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:33:27.189729 32342 tablet_replica.cc:330] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123: stopping tablet replica
I20260808 23:33:27.189973 32339 raft_consensus.cc:2258] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:27.190531 32342 raft_consensus.cc:2229] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:27.191195 32342 raft_consensus.cc:2258] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:27.191859 32341 raft_consensus.cc:2229] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:27.192504 32341 raft_consensus.cc:2258] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:27.192721 32339 ts_tablet_manager.cc:1905] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:27.195181 32341 ts_tablet_manager.cc:1905] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:27.195580 32342 ts_tablet_manager.cc:1905] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:27.202394 32339 ts_tablet_manager.cc:1918] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:27.202632 32339 log.cc:1196] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/4bf0b4b9cdfa4cb5b8f8ff446db4791c
I20260808 23:33:27.203336 32339 ts_tablet_manager.cc:1939] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 96f585b22bcc47249bdd4f3675aebb5e: Deleting consensus metadata
I20260808 23:33:27.204087 32341 ts_tablet_manager.cc:1918] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:27.204380 32341 log.cc:1196] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/4bf0b4b9cdfa4cb5b8f8ff446db4791c
I20260808 23:33:27.205247 32341 ts_tablet_manager.cc:1939] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 59a16e44ba584c949ca693529fcc43ae: Deleting consensus metadata
Aug 08 23:33:27 dist-test-slave-1x4g krb5kdc[31764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:33:27.206208 31795 catalog_manager.cc:4841] TS 96f585b22bcc47249bdd4f3675aebb5e (127.26.207.193:38157): tablet 4bf0b4b9cdfa4cb5b8f8ff446db4791c (table test-table [id=d73a5c865c3743c0bac9d3050f92eb73]) successfully deleted
I20260808 23:33:27.207918 31794 catalog_manager.cc:4841] TS 59a16e44ba584c949ca693529fcc43ae (127.26.207.194:33855): tablet 4bf0b4b9cdfa4cb5b8f8ff446db4791c (table test-table [id=d73a5c865c3743c0bac9d3050f92eb73]) successfully deleted
I20260808 23:33:27.210456 32342 ts_tablet_manager.cc:1918] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:27.210671 32342 log.cc:1196] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/4bf0b4b9cdfa4cb5b8f8ff446db4791c
I20260808 23:33:27.211316 32342 ts_tablet_manager.cc:1939] T 4bf0b4b9cdfa4cb5b8f8ff446db4791c P 649d833cf66e428ea0cbac1b99339123: Deleting consensus metadata
I20260808 23:33:27.213639 31794 catalog_manager.cc:4841] TS 649d833cf66e428ea0cbac1b99339123 (127.26.207.195:40475): tablet 4bf0b4b9cdfa4cb5b8f8ff446db4791c (table test-table [id=d73a5c865c3743c0bac9d3050f92eb73]) successfully deleted
I20260808 23:33:27.216024 32310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:27.182117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58798 (local address 127.26.207.193:38157)
0808 23:33:27.182342 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:27.182350 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:27.182651 (+ 301us) server_negotiation.cc:407] Connection header received
0808 23:33:27.183165 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:27.183172 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:27.183291 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:27.183429 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:27.189288 (+ 5859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:27.190651 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:27.192692 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:27.193544 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:27.193664 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:27.207233 (+ 13569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:27.207252 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:27.207274 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:27.207342 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:27.212324 (+ 4982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:27.213534 (+ 1210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:27.213542 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:27.213545 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:27.213704 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:27.214221 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:27.214225 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:27.214227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:27.214644 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:27.215019 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:27.215353 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 23:33:27.215637 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 23:33:27.216861 32011 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:27.322418 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 31878
I20260808 23:33:27.345916 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 32025
Aug 08 23:33:27 dist-test-slave-1x4g krb5kdc[31764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:33:27.362457 32311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:27.346675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43378 (local address 127.26.207.194:33855)
0808 23:33:27.347097 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:27.347102 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:27.347117 (+ 15us) server_negotiation.cc:407] Connection header received
0808 23:33:27.347173 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:27.347177 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:27.347240 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:27.347318 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:27.348623 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:27.349473 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:27.350784 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:27.351172 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:27.351272 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:27.356314 (+ 5042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:27.356333 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:27.356351 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:27.356403 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:27.359300 (+ 2897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:27.360063 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:27.360071 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:27.360073 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:27.360214 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:27.360671 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:27.360674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:27.360676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:27.361117 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:27.361347 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:27.361741 (+ 394us) server_negotiation.cc:299] Negotiation successful
0808 23:33:27.362050 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283}
I20260808 23:33:27.363234 32151 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:27.455528 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 32025
I20260808 23:33:27.479676 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 32162
Aug 08 23:33:27 dist-test-slave-1x4g krb5kdc[31764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:33:27.495968 32309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:27.480607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59562 (local address 127.26.207.195:40475)
0808 23:33:27.480855 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:27.480861 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:27.480917 (+ 56us) server_negotiation.cc:407] Connection header received
0808 23:33:27.481072 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:27.481082 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:27.481170 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:27.481288 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:27.482696 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:27.483442 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:27.484748 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:27.485261 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:27.485411 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:27.490094 (+ 4683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:27.490112 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:27.490129 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:27.490172 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:27.493102 (+ 2930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:27.493920 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:27.493928 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:27.493931 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:27.494098 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:27.494467 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:27.494470 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:27.494472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:27.494861 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:27.495126 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:27.495458 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 23:33:27.495648 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 23:33:27.496869 32289 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:27.588975 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 32162
I20260808 23:33:27.610607 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 31778
I20260808 23:33:27.611858 31843 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:27.726131 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 31778
2026-08-08T23:33:27Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4870 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T23:33:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:33:27Z Disabled control of system clock
I20260808 23:33:27.812522 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:39403
--webserver_interface=127.26.207.254
--webserver_port=0
--builtin_ntp_servers=127.26.207.212:43213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:39403
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 23:33:28.174995 32351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:28.175357 32351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:28.175448 32351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:28.183310 32351 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:33:28.183470 32351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:28.183509 32351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:28.183560 32351 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:33:28.183609 32351 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:33:28.193547 32351 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:39403
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:39403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:28.194996 32351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:28.196970 32351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:28.210681 32359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:28.210737 32357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:28.210637 32356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:28.214461 32351 server_base.cc:1034] running on GCE node
I20260808 23:33:28.215440 32351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:28.217283 32351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:28.218590 32351 hybrid_clock.cc:648] HybridClock initialized: now 1786232008218540 us; error 53 us; skew 500 ppm
I20260808 23:33:28.219121 32351 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:33:28.222332 32351 webserver.cc:460] Webserver started at http://127.26.207.254:40025/ using document root <none> and password file <none>
I20260808 23:33:28.223222 32351 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:28.223403 32351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:28.223798 32351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:28.227386 32351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "5c99fb5c560147e5b46f791d053a12c5"
format_stamp: "Formatted at 2026-08-08 23:33:28 on dist-test-slave-1x4g"
server_key: "58287f7f829f4bcff74dd46809191c6b"
server_key_iv: "899d3caf27d6c060c6ecbbf189339366"
server_key_version: "encryptionkey@0"
I20260808 23:33:28.228451 32351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "5c99fb5c560147e5b46f791d053a12c5"
format_stamp: "Formatted at 2026-08-08 23:33:28 on dist-test-slave-1x4g"
server_key: "58287f7f829f4bcff74dd46809191c6b"
server_key_iv: "899d3caf27d6c060c6ecbbf189339366"
server_key_version: "encryptionkey@0"
I20260808 23:33:28.235327 32351 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260808 23:33:28.239858 32365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:28.241601 32351 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:33:28.241848 32351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "5c99fb5c560147e5b46f791d053a12c5"
format_stamp: "Formatted at 2026-08-08 23:33:28 on dist-test-slave-1x4g"
server_key: "58287f7f829f4bcff74dd46809191c6b"
server_key_iv: "899d3caf27d6c060c6ecbbf189339366"
server_key_version: "encryptionkey@0"
I20260808 23:33:28.242136 32351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:28.249218 32351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:28.250169 32351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:28.250527 32351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:28.272562 32351 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:39403
I20260808 23:33:28.272610 32419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:39403 every 8 connection(s)
I20260808 23:33:28.274322 32351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:33:28.278838 32420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:28.279716 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 32351
I20260808 23:33:28.279956 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:33:28.280728 27455 external_mini_cluster.cc:1428] Setting key 72025555a8b561e5dd67fe4223333641
I20260808 23:33:28.291152 32424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:28.283244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38082 (local address 127.26.207.254:39403)
0808 23:33:28.284750 (+ 1506us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:28.284764 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:28.284917 (+ 153us) server_negotiation.cc:407] Connection header received
0808 23:33:28.286683 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:28.286716 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:28.287305 (+ 589us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:28.287822 (+ 517us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:28.289202 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:28.289208 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:28.289224 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:28.289243 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:28.289304 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:28.289320 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:28.289606 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:28.289763 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 23:33:28.290079 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":920,"thread_start_us":543,"threads_started":1}
I20260808 23:33:28.295189 32420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5: Bootstrap starting.
I20260808 23:33:28.299126 32420 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:28.300345 32420 log.cc:824] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:28.304186 32420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5: No bootstrap required, opened a new log
I20260808 23:33:28.312623 32420 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c99fb5c560147e5b46f791d053a12c5" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 39403 } }
I20260808 23:33:28.313184 32420 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:28.313313 32420 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c99fb5c560147e5b46f791d053a12c5, State: Initialized, Role: FOLLOWER
I20260808 23:33:28.314044 32420 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c99fb5c560147e5b46f791d053a12c5" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 39403 } }
I20260808 23:33:28.314342 32420 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:33:28.314508 32420 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:33:28.314700 32420 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:28.317610 32420 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c99fb5c560147e5b46f791d053a12c5" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 39403 } }
I20260808 23:33:28.318244 32420 leader_election.cc:302] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c99fb5c560147e5b46f791d053a12c5; no voters:
I20260808 23:33:28.318966 32420 leader_election.cc:288] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:33:28.319203 32428 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:28.320070 32428 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [term 1 LEADER]: Becoming Leader. State: Replica: 5c99fb5c560147e5b46f791d053a12c5, State: Running, Role: LEADER
I20260808 23:33:28.320891 32428 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c99fb5c560147e5b46f791d053a12c5" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 39403 } }
I20260808 23:33:28.321976 32420 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:33:28.324215 32429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c99fb5c560147e5b46f791d053a12c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c99fb5c560147e5b46f791d053a12c5" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 39403 } } }
I20260808 23:33:28.324733 32429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:28.326922 32430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c99fb5c560147e5b46f791d053a12c5. Latest consensus state: current_term: 1 leader_uuid: "5c99fb5c560147e5b46f791d053a12c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c99fb5c560147e5b46f791d053a12c5" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 39403 } } }
I20260808 23:33:28.327375 32430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:28.327433 32435 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:33:28.334422 32435 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:33:28.345678 32435 catalog_manager.cc:1347] Generated new cluster ID: 24716695d7ee432eaf95d0ca3330d443
I20260808 23:33:28.345837 32435 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:33:28.373167 32435 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:33:28.373737 32435 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:33:28.384323 32435 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5: Generated new TSK 0
I20260808 23:33:28.385432 32435 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:33:28.394040 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:39403
--builtin_ntp_servers=127.26.207.212:43213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 23:33:28.771075 32448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:28.771574 32448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:28.771736 32448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:28.781482 32448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:28.781621 32448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:28.781816 32448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:33:28.792048 32448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:39403
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:28.793638 32448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:28.795631 32448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:28.811167 32453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:28.811172 32457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:28.811131 32455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:28.812180 32448 server_base.cc:1034] running on GCE node
I20260808 23:33:28.812953 32448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:28.814061 32448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:28.815265 32448 hybrid_clock.cc:648] HybridClock initialized: now 1786232008815220 us; error 45 us; skew 500 ppm
I20260808 23:33:28.815588 32448 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:33:28.818225 32448 webserver.cc:460] Webserver started at http://127.26.207.193:36303/ using document root <none> and password file <none>
I20260808 23:33:28.818948 32448 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:28.819053 32448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:28.819347 32448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:28.822664 32448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "52f91bd5a4e64667812bb51a377997e1"
format_stamp: "Formatted at 2026-08-08 23:33:28 on dist-test-slave-1x4g"
server_key: "d6e7627ca9d92358adde4b7c9fc8ab67"
server_key_iv: "83d5560a8cb3e6fc3e7987f0f07763b6"
server_key_version: "encryptionkey@0"
I20260808 23:33:28.823684 32448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "52f91bd5a4e64667812bb51a377997e1"
format_stamp: "Formatted at 2026-08-08 23:33:28 on dist-test-slave-1x4g"
server_key: "d6e7627ca9d92358adde4b7c9fc8ab67"
server_key_iv: "83d5560a8cb3e6fc3e7987f0f07763b6"
server_key_version: "encryptionkey@0"
I20260808 23:33:28.830751 32448 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.004s
I20260808 23:33:28.836078 32463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:28.837807 32448 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:33:28.837988 32448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "52f91bd5a4e64667812bb51a377997e1"
format_stamp: "Formatted at 2026-08-08 23:33:28 on dist-test-slave-1x4g"
server_key: "d6e7627ca9d92358adde4b7c9fc8ab67"
server_key_iv: "83d5560a8cb3e6fc3e7987f0f07763b6"
server_key_version: "encryptionkey@0"
I20260808 23:33:28.838222 32448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:28.845033 32448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:28.845949 32448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:28.846313 32448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:28.847395 32448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:28.849149 32448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:28.849251 32448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:28.849342 32448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:28.849399 32448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:28.886266 32448 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:39221
I20260808 23:33:28.886346 32581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:39221 every 8 connection(s)
I20260808 23:33:28.887916 32448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:33:28.897336 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 32448
I20260808 23:33:28.897593 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:33:28.897725 32584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:28.890932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:57163 (local address 127.26.207.254:39403)
0808 23:33:28.891426 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:28.891431 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:28.892943 (+ 1512us) server_negotiation.cc:407] Connection header received
0808 23:33:28.894877 (+ 1934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:28.894884 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:28.894989 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:28.895124 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:28.896731 (+ 1607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:28.896738 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:28.896743 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:28.896841 (+ 98us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:28.896903 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:28.896917 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:28.897082 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:28.897297 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 23:33:28.897386 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":261,"threads_started":1}
I20260808 23:33:28.898396 27455 external_mini_cluster.cc:1428] Setting key fccd485683f3097287f46156b5e2814d
I20260808 23:33:28.898948 32585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:28.891661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:39403 (local address 127.26.207.193:57163)
0808 23:33:28.892700 (+ 1039us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:28.892746 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:28.894531 (+ 1785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:28.895419 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:28.895429 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:28.895544 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:28.896341 (+ 797us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:33:28.896344 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:28.896388 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:33:28.896501 (+ 113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:28.897035 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:28.897047 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:28.897056 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 23:33:28.897401 (+ 345us) client_negotiation.cc:240] Negotiation successful
0808 23:33:28.897744 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":305,"threads_started":1}
I20260808 23:33:28.901239 32582 heartbeater.cc:347] Connected to a master server at 127.26.207.254:39403
I20260808 23:33:28.901638 32582 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:28.901826 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:39403
--builtin_ntp_servers=127.26.207.212:43213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 23:33:28.902415 32582 heartbeater.cc:511] Master 127.26.207.254:39403 requested a full tablet report, sending...
I20260808 23:33:28.904877 32385 ts_manager.cc:194] Registered new tserver with Master: 52f91bd5a4e64667812bb51a377997e1 (127.26.207.193:39221)
W20260808 23:33:29.265738 32586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:29.266096 32586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:29.266196 32586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:29.274951 32586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:29.275096 32586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:29.275269 32586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:33:29.291244 32586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:39403
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:29.293041 32586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:29.295044 32586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:29.310412 32591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:29.310362 32594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:29.310375 32592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:29.311430 32586 server_base.cc:1034] running on GCE node
I20260808 23:33:29.312146 32586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:29.313292 32586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:29.314553 32586 hybrid_clock.cc:648] HybridClock initialized: now 1786232009314485 us; error 65 us; skew 500 ppm
I20260808 23:33:29.314924 32586 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:33:29.317658 32586 webserver.cc:460] Webserver started at http://127.26.207.194:39729/ using document root <none> and password file <none>
I20260808 23:33:29.318472 32586 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:29.318627 32586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:29.319003 32586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:29.322294 32586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "ad2a7684e1254abeb58b1c024b7ab840"
format_stamp: "Formatted at 2026-08-08 23:33:29 on dist-test-slave-1x4g"
server_key: "03efdb37b67f86f42477805e874e3f60"
server_key_iv: "9ffce269d90122a75d02bebca5c8f0ef"
server_key_version: "encryptionkey@0"
I20260808 23:33:29.323288 32586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "ad2a7684e1254abeb58b1c024b7ab840"
format_stamp: "Formatted at 2026-08-08 23:33:29 on dist-test-slave-1x4g"
server_key: "03efdb37b67f86f42477805e874e3f60"
server_key_iv: "9ffce269d90122a75d02bebca5c8f0ef"
server_key_version: "encryptionkey@0"
I20260808 23:33:29.329581 32586 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 23:33:29.333878 32600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:29.335479 32586 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260808 23:33:29.335698 32586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "ad2a7684e1254abeb58b1c024b7ab840"
format_stamp: "Formatted at 2026-08-08 23:33:29 on dist-test-slave-1x4g"
server_key: "03efdb37b67f86f42477805e874e3f60"
server_key_iv: "9ffce269d90122a75d02bebca5c8f0ef"
server_key_version: "encryptionkey@0"
I20260808 23:33:29.335994 32586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:29.342491 32586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:29.343444 32586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:29.343766 32586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:29.344987 32586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:29.346726 32586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:29.346859 32586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:29.347018 32586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:29.347113 32586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:29.383615 32586 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:44677
I20260808 23:33:29.383674 32718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:44677 every 8 connection(s)
I20260808 23:33:29.385172 32586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:33:29.390053 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 32586
I20260808 23:33:29.390259 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:33:29.390789 27455 external_mini_cluster.cc:1428] Setting key 29c5f11d9c55acde0e5daa74ad64154a
I20260808 23:33:29.394232 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:39403
--builtin_ntp_servers=127.26.207.212:43213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 23:33:29.395424 32584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:29.388336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:53865 (local address 127.26.207.254:39403)
0808 23:33:29.388528 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:29.388533 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:29.390275 (+ 1742us) server_negotiation.cc:407] Connection header received
0808 23:33:29.392610 (+ 2335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:29.392615 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:29.392668 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:29.392846 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:29.394612 (+ 1766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:29.394618 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:29.394623 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:29.394651 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:29.394694 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:29.394707 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:29.394861 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:29.395070 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 23:33:29.395149 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 23:33:29.396579 32722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:29.388889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:39403 (local address 127.26.207.194:53865)
0808 23:33:29.390056 (+ 1167us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:29.390110 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:29.392249 (+ 2139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:29.393181 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:29.393196 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:29.393323 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:29.394133 (+ 810us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:33:29.394136 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:29.394183 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:33:29.394291 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:29.394817 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:29.394831 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:29.394841 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 23:33:29.395174 (+ 333us) client_negotiation.cc:240] Negotiation successful
0808 23:33:29.395517 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":326,"threads_started":1}
I20260808 23:33:29.398411 32719 heartbeater.cc:347] Connected to a master server at 127.26.207.254:39403
I20260808 23:33:29.398787 32719 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:29.399528 32719 heartbeater.cc:511] Master 127.26.207.254:39403 requested a full tablet report, sending...
I20260808 23:33:29.401326 32385 ts_manager.cc:194] Registered new tserver with Master: ad2a7684e1254abeb58b1c024b7ab840 (127.26.207.194:44677)
W20260808 23:33:29.757061 32723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:29.757426 32723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:29.757597 32723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:29.765532 32723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:29.765691 32723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:29.765878 32723 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:33:29.776294 32723 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:39403
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:29.777848 32723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:29.779819 32723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:29.794744 32729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:29.794706 32730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:29.794667 32732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:29.795678 32723 server_base.cc:1034] running on GCE node
I20260808 23:33:29.796435 32723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:29.797792 32723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:29.799108 32723 hybrid_clock.cc:648] HybridClock initialized: now 1786232009799060 us; error 69 us; skew 500 ppm
I20260808 23:33:29.799548 32723 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:33:29.802537 32723 webserver.cc:460] Webserver started at http://127.26.207.195:38967/ using document root <none> and password file <none>
I20260808 23:33:29.803403 32723 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:29.803567 32723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:29.803953 32723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:29.807404 32723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "de084f9efc2e4c9b9f2d2eb880258658"
format_stamp: "Formatted at 2026-08-08 23:33:29 on dist-test-slave-1x4g"
server_key: "8b38d5d790d3c115ac95bda80d9859ec"
server_key_iv: "4da3d36e7fd98b2f896f433ca4f246cf"
server_key_version: "encryptionkey@0"
I20260808 23:33:29.808451 32723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "de084f9efc2e4c9b9f2d2eb880258658"
format_stamp: "Formatted at 2026-08-08 23:33:29 on dist-test-slave-1x4g"
server_key: "8b38d5d790d3c115ac95bda80d9859ec"
server_key_iv: "4da3d36e7fd98b2f896f433ca4f246cf"
server_key_version: "encryptionkey@0"
I20260808 23:33:29.814944 32723 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260808 23:33:29.819399 32738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:29.821189 32723 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:33:29.821372 32723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "de084f9efc2e4c9b9f2d2eb880258658"
format_stamp: "Formatted at 2026-08-08 23:33:29 on dist-test-slave-1x4g"
server_key: "8b38d5d790d3c115ac95bda80d9859ec"
server_key_iv: "4da3d36e7fd98b2f896f433ca4f246cf"
server_key_version: "encryptionkey@0"
I20260808 23:33:29.821605 32723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:29.828287 32723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:29.829418 32723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:29.829713 32723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:29.830809 32723 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:29.832644 32723 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:29.832754 32723 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:29.832943 32723 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:29.833058 32723 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:29.869679 32723 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:36107
I20260808 23:33:29.869773 386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:36107 every 8 connection(s)
I20260808 23:33:29.871240 32723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:33:29.872407 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 32723
I20260808 23:33:29.872612 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:33:29.873210 27455 external_mini_cluster.cc:1428] Setting key a112fffdbaf9eb3f86bf978227b273c6
I20260808 23:33:29.880959 32584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:29.874607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:42397 (local address 127.26.207.254:39403)
0808 23:33:29.875527 (+ 920us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:29.875532 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:29.876735 (+ 1203us) server_negotiation.cc:407] Connection header received
0808 23:33:29.878785 (+ 2050us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:29.878790 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:29.878846 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:29.878932 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:29.880252 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:29.880256 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:29.880259 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:29.880277 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:29.880311 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:29.880324 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:29.880423 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:29.880614 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 23:33:29.880668 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":797}
I20260808 23:33:29.881978 390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:29.875227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:39403 (local address 127.26.207.195:42397)
0808 23:33:29.876532 (+ 1305us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:29.876613 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:29.878503 (+ 1890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:29.879163 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:29.879171 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:29.879271 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:29.879936 (+ 665us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:33:29.879938 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:29.879980 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:33:29.880075 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:29.880415 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:29.880433 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:29.880438 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 23:33:29.880664 (+ 226us) client_negotiation.cc:240] Negotiation successful
0808 23:33:29.880950 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":429,"threads_started":1}
I20260808 23:33:29.883535 387 heartbeater.cc:347] Connected to a master server at 127.26.207.254:39403
I20260808 23:33:29.883831 387 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:29.884464 387 heartbeater.cc:511] Master 127.26.207.254:39403 requested a full tablet report, sending...
I20260808 23:33:29.886150 32385 ts_manager.cc:194] Registered new tserver with Master: de084f9efc2e4c9b9f2d2eb880258658 (127.26.207.195:36107)
I20260808 23:33:29.890563 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:33:29.898592 32584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:29.895950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56606 (local address 127.26.207.254:39403)
0808 23:33:29.896142 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:29.896148 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:29.896655 (+ 507us) server_negotiation.cc:407] Connection header received
0808 23:33:29.896873 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:29.896877 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:29.896935 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:29.897096 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:29.898028 (+ 932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:29.898033 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:29.898036 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:29.898055 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:29.898091 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:29.898104 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:29.898215 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:29.898303 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 23:33:29.898355 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 23:33:29.908186 32582 heartbeater.cc:503] Master 127.26.207.254:39403 was elected leader, sending a full tablet report...
I20260808 23:33:29.903049 32385 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56606:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:33:29.910696 32385 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:33:29.931676 403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:29.924381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:36107 (local address 127.0.0.1:37874)
0808 23:33:29.926662 (+ 2281us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:29.926688 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:29.926832 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:29.928173 (+ 1341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:29.928185 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:29.928312 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:29.929634 (+ 1322us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:33:29.929640 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:29.929686 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:33:29.929806 (+ 120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:29.930605 (+ 799us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:29.930629 (+ 24us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:29.930643 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 23:33:29.930870 (+ 227us) client_negotiation.cc:240] Negotiation successful
0808 23:33:29.931002 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2036,"thread_start_us":1877,"threads_started":1}
I20260808 23:33:29.932489 402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:29.924220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:44677 (local address 127.0.0.1:55088)
0808 23:33:29.925311 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:29.925366 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:29.925577 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:29.928334 (+ 2757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:29.928342 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:29.928379 (+ 37us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:29.930741 (+ 2362us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:33:29.930747 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:29.930770 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:33:29.930840 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:29.931574 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:29.931582 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:29.931591 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 23:33:29.931802 (+ 211us) client_negotiation.cc:240] Negotiation successful
0808 23:33:29.931880 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":715,"thread_start_us":1252,"threads_started":1}
I20260808 23:33:29.933250 404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:29.925081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37874 (local address 127.26.207.195:36107)
0808 23:33:29.927477 (+ 2396us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:29.927486 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:29.927522 (+ 36us) server_negotiation.cc:407] Connection header received
0808 23:33:29.927605 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:29.927618 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:29.927871 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:29.928813 (+ 942us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:29.930244 (+ 1431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:29.930258 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:29.930279 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:29.930303 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:29.930376 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:29.930402 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:29.932396 (+ 1994us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:29.932499 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 23:33:29.932664 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2176,"thread_start_us":2292,"threads_started":1}
I20260808 23:33:29.934104 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:29.924279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55088 (local address 127.26.207.194:44677)
0808 23:33:29.926269 (+ 1990us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:29.926278 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:29.926310 (+ 32us) server_negotiation.cc:407] Connection header received
0808 23:33:29.926393 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:29.926401 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:29.926675 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:29.927101 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:29.931119 (+ 4018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:29.931134 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:29.931154 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:29.931198 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:29.931286 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:29.931315 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:29.931492 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:29.933598 (+ 2106us) server_negotiation.cc:299] Negotiation successful
0808 23:33:29.933738 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1776,"thread_start_us":1604,"threads_started":1}
I20260808 23:33:29.937400 403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:29.926848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:39221 (local address 127.0.0.1:60986)
0808 23:33:29.931957 (+ 5109us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:29.931977 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:29.932088 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:29.935101 (+ 3013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:29.935107 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:29.935166 (+ 59us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:29.935865 (+ 699us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:33:29.935868 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:29.935888 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:33:29.935946 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:29.936926 (+ 980us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:29.936932 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:29.936938 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 23:33:29.937052 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 23:33:29.937117 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5012,"threads_started":1}
I20260808 23:33:29.937837 406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:29.927224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60986 (local address 127.26.207.193:39221)
0808 23:33:29.934299 (+ 7075us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:29.934314 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:29.934360 (+ 46us) server_negotiation.cc:407] Connection header received
0808 23:33:29.934462 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:29.934477 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:29.934837 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:29.935084 (+ 247us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:29.936580 (+ 1496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:29.936593 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:29.936631 (+ 38us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:29.936659 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:29.936735 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:29.936762 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:29.937054 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:29.937138 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 23:33:29.937280 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6816,"thread_start_us":6609,"threads_started":1}
I20260808 23:33:29.938885 32650 tablet_service.cc:1467] Processing CreateTablet for tablet 29d1f3849c0f49f18e20dc3bf906b3ba (DEFAULT_TABLE table=test-table [id=76024f808e8d4e4399215eeb3bd4e7e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:29.940582 32650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29d1f3849c0f49f18e20dc3bf906b3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:29.942800 319 tablet_service.cc:1467] Processing CreateTablet for tablet 29d1f3849c0f49f18e20dc3bf906b3ba (DEFAULT_TABLE table=test-table [id=76024f808e8d4e4399215eeb3bd4e7e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:29.942776 32512 tablet_service.cc:1467] Processing CreateTablet for tablet 29d1f3849c0f49f18e20dc3bf906b3ba (DEFAULT_TABLE table=test-table [id=76024f808e8d4e4399215eeb3bd4e7e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:29.944307 319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29d1f3849c0f49f18e20dc3bf906b3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:29.944348 32512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29d1f3849c0f49f18e20dc3bf906b3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:29.958837 408 tablet_bootstrap.cc:492] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840: Bootstrap starting.
I20260808 23:33:29.961093 409 tablet_bootstrap.cc:492] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1: Bootstrap starting.
I20260808 23:33:29.961558 407 tablet_bootstrap.cc:492] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658: Bootstrap starting.
I20260808 23:33:29.964964 409 tablet_bootstrap.cc:654] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:29.966143 407 tablet_bootstrap.cc:654] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:29.966144 409 log.cc:824] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:29.966897 408 tablet_bootstrap.cc:654] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:29.967463 407 log.cc:824] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:29.968330 408 log.cc:824] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:29.969784 409 tablet_bootstrap.cc:492] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1: No bootstrap required, opened a new log
I20260808 23:33:29.970147 409 ts_tablet_manager.cc:1397] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.006s
I20260808 23:33:29.971184 407 tablet_bootstrap.cc:492] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658: No bootstrap required, opened a new log
I20260808 23:33:29.971486 407 ts_tablet_manager.cc:1397] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 23:33:29.971918 408 tablet_bootstrap.cc:492] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840: No bootstrap required, opened a new log
I20260808 23:33:29.972184 408 ts_tablet_manager.cc:1397] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.007s
I20260808 23:33:29.979259 407 raft_consensus.cc:348] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2a7684e1254abeb58b1c024b7ab840" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44677 } } peers { permanent_uuid: "de084f9efc2e4c9b9f2d2eb880258658" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36107 } } peers { permanent_uuid: "52f91bd5a4e64667812bb51a377997e1" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 39221 } }
I20260808 23:33:29.979875 407 raft_consensus.cc:374] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:29.980021 407 raft_consensus.cc:729] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de084f9efc2e4c9b9f2d2eb880258658, State: Initialized, Role: FOLLOWER
I20260808 23:33:29.980850 407 consensus_queue.cc:260] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2a7684e1254abeb58b1c024b7ab840" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44677 } } peers { permanent_uuid: "de084f9efc2e4c9b9f2d2eb880258658" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36107 } } peers { permanent_uuid: "52f91bd5a4e64667812bb51a377997e1" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 39221 } }
I20260808 23:33:29.982129 409 raft_consensus.cc:348] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2a7684e1254abeb58b1c024b7ab840" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44677 } } peers { permanent_uuid: "de084f9efc2e4c9b9f2d2eb880258658" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36107 } } peers { permanent_uuid: "52f91bd5a4e64667812bb51a377997e1" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 39221 } }
I20260808 23:33:29.982931 387 heartbeater.cc:503] Master 127.26.207.254:39403 was elected leader, sending a full tablet report...
I20260808 23:33:29.983567 407 ts_tablet_manager.cc:1428] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260808 23:33:29.983842 409 raft_consensus.cc:374] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:29.984017 409 raft_consensus.cc:729] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f91bd5a4e64667812bb51a377997e1, State: Initialized, Role: FOLLOWER
I20260808 23:33:29.983829 408 raft_consensus.cc:348] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2a7684e1254abeb58b1c024b7ab840" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44677 } } peers { permanent_uuid: "de084f9efc2e4c9b9f2d2eb880258658" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36107 } } peers { permanent_uuid: "52f91bd5a4e64667812bb51a377997e1" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 39221 } }
I20260808 23:33:29.984388 408 raft_consensus.cc:374] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:29.984519 408 raft_consensus.cc:729] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2a7684e1254abeb58b1c024b7ab840, State: Initialized, Role: FOLLOWER
I20260808 23:33:29.984833 409 consensus_queue.cc:260] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2a7684e1254abeb58b1c024b7ab840" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44677 } } peers { permanent_uuid: "de084f9efc2e4c9b9f2d2eb880258658" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36107 } } peers { permanent_uuid: "52f91bd5a4e64667812bb51a377997e1" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 39221 } }
I20260808 23:33:29.985219 408 consensus_queue.cc:260] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2a7684e1254abeb58b1c024b7ab840" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44677 } } peers { permanent_uuid: "de084f9efc2e4c9b9f2d2eb880258658" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36107 } } peers { permanent_uuid: "52f91bd5a4e64667812bb51a377997e1" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 39221 } }
I20260808 23:33:29.986943 409 ts_tablet_manager.cc:1428] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1: Time spent starting tablet: real 0.017s user 0.015s sys 0.001s
I20260808 23:33:29.989266 32719 heartbeater.cc:503] Master 127.26.207.254:39403 was elected leader, sending a full tablet report...
I20260808 23:33:29.990031 408 ts_tablet_manager.cc:1428] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840: Time spent starting tablet: real 0.018s user 0.014s sys 0.006s
W20260808 23:33:30.123378 388 tablet.cc:2369] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:33:30.137722 32720 tablet.cc:2369] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:33:30.140584 32583 tablet.cc:2369] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:33:30.308727 414 raft_consensus.cc:482] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:33:30.309157 414 raft_consensus.cc:504] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2a7684e1254abeb58b1c024b7ab840" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44677 } } peers { permanent_uuid: "de084f9efc2e4c9b9f2d2eb880258658" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36107 } } peers { permanent_uuid: "52f91bd5a4e64667812bb51a377997e1" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 39221 } }
I20260808 23:33:30.311177 414 leader_election.cc:288] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2a7684e1254abeb58b1c024b7ab840 (127.26.207.194:44677), de084f9efc2e4c9b9f2d2eb880258658 (127.26.207.195:36107)
I20260808 23:33:30.314247 415 raft_consensus.cc:482] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:33:30.314653 415 raft_consensus.cc:504] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2a7684e1254abeb58b1c024b7ab840" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44677 } } peers { permanent_uuid: "de084f9efc2e4c9b9f2d2eb880258658" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36107 } } peers { permanent_uuid: "52f91bd5a4e64667812bb51a377997e1" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 39221 } }
I20260808 23:33:30.315196 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.311642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:56801 (local address 127.26.207.194:44677)
0808 23:33:30.311848 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:30.311855 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:30.312717 (+ 862us) server_negotiation.cc:407] Connection header received
0808 23:33:30.312946 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:30.312952 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:30.313024 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:30.313104 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:30.314389 (+ 1285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:30.314397 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:30.314404 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:30.314430 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:30.314476 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:30.314493 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:30.314646 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:30.314806 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 23:33:30.314906 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 23:33:30.315378 416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.311643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:44677 (local address 127.26.207.193:56801)
0808 23:33:30.312565 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:30.312590 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:30.312730 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:30.313179 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:30.313183 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:30.313210 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:30.314155 (+ 945us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:33:30.314158 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:30.314174 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:33:30.314220 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:30.314657 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:30.314663 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:30.314668 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 23:33:30.314830 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 23:33:30.314893 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":764,"thread_start_us":492,"threads_started":1}
I20260808 23:33:30.315698 404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.311884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:43553 (local address 127.26.207.195:36107)
0808 23:33:30.312131 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:30.312138 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:30.312825 (+ 687us) server_negotiation.cc:407] Connection header received
0808 23:33:30.313000 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:30.313004 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:30.313056 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:30.313178 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:30.314908 (+ 1730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:30.314915 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:30.314920 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:30.314943 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:30.314982 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:30.314998 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:30.315105 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:30.315372 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 23:33:30.315444 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 23:33:30.316460 417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.311817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:36107 (local address 127.26.207.193:43553)
0808 23:33:30.312652 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:30.312693 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:30.312864 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:30.313238 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:30.313242 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:30.313269 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:30.314657 (+ 1388us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:33:30.314660 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:30.314678 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:33:30.314724 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:30.315207 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:30.315211 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:30.315215 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 23:33:30.315952 (+ 737us) client_negotiation.cc:240] Negotiation successful
0808 23:33:30.316015 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":732,"thread_start_us":519,"threads_started":1}
I20260808 23:33:30.316830 415 leader_election.cc:288] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de084f9efc2e4c9b9f2d2eb880258658 (127.26.207.195:36107), 52f91bd5a4e64667812bb51a377997e1 (127.26.207.193:39221)
I20260808 23:33:30.316910 32670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29d1f3849c0f49f18e20dc3bf906b3ba" candidate_uuid: "52f91bd5a4e64667812bb51a377997e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2a7684e1254abeb58b1c024b7ab840" is_pre_election: true
I20260808 23:33:30.317443 32670 raft_consensus.cc:2454] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52f91bd5a4e64667812bb51a377997e1 in term 0.
I20260808 23:33:30.317685 340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29d1f3849c0f49f18e20dc3bf906b3ba" candidate_uuid: "52f91bd5a4e64667812bb51a377997e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de084f9efc2e4c9b9f2d2eb880258658" is_pre_election: true
I20260808 23:33:30.318322 340 raft_consensus.cc:2454] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52f91bd5a4e64667812bb51a377997e1 in term 0.
I20260808 23:33:30.319226 32464 leader_election.cc:302] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52f91bd5a4e64667812bb51a377997e1, de084f9efc2e4c9b9f2d2eb880258658; no voters:
I20260808 23:33:30.319710 414 raft_consensus.cc:2781] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:33:30.319834 414 raft_consensus.cc:482] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:33:30.319952 414 raft_consensus.cc:3037] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:30.321349 404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.317575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:35285 (local address 127.26.207.195:36107)
0808 23:33:30.317761 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:30.317767 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:30.318434 (+ 667us) server_negotiation.cc:407] Connection header received
0808 23:33:30.318708 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:30.318713 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:30.318790 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:30.318889 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:30.320409 (+ 1520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:30.320418 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:30.320426 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:30.320455 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:30.320512 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:30.320534 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:30.320712 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:30.320847 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 23:33:30.320934 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 23:33:30.321422 418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.317413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:36107 (local address 127.26.207.194:35285)
0808 23:33:30.318327 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:30.318351 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:30.318546 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:30.319137 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:30.319142 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:30.319168 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:30.320118 (+ 950us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:33:30.320122 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:30.320144 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:33:30.320206 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:30.320675 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:30.320680 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:30.320686 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 23:33:30.320878 (+ 192us) client_negotiation.cc:240] Negotiation successful
0808 23:33:30.320940 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":766,"thread_start_us":549,"threads_started":1}
I20260808 23:33:30.323496 414 raft_consensus.cc:504] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2a7684e1254abeb58b1c024b7ab840" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44677 } } peers { permanent_uuid: "de084f9efc2e4c9b9f2d2eb880258658" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36107 } } peers { permanent_uuid: "52f91bd5a4e64667812bb51a377997e1" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 39221 } }
I20260808 23:33:30.324352 406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.318492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:44523 (local address 127.26.207.193:39221)
0808 23:33:30.319069 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:30.319078 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:30.321752 (+ 2674us) server_negotiation.cc:407] Connection header received
0808 23:33:30.321876 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:30.321893 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:30.321974 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:30.322129 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:30.323232 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:30.323241 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:30.323250 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:30.323276 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:30.323353 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:30.323376 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:30.323575 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:30.323870 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 23:33:30.323976 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400}
I20260808 23:33:30.324761 340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29d1f3849c0f49f18e20dc3bf906b3ba" candidate_uuid: "52f91bd5a4e64667812bb51a377997e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de084f9efc2e4c9b9f2d2eb880258658"
I20260808 23:33:30.324892 414 leader_election.cc:288] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [CANDIDATE]: Term 1 election: Requested vote from peers ad2a7684e1254abeb58b1c024b7ab840 (127.26.207.194:44677), de084f9efc2e4c9b9f2d2eb880258658 (127.26.207.195:36107)
I20260808 23:33:30.325063 340 raft_consensus.cc:3037] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:30.325217 418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.318409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:39221 (local address 127.26.207.194:44523)
0808 23:33:30.321636 (+ 3227us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:30.321656 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:30.321755 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:30.322142 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:30.322148 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:30.322192 (+ 44us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:30.322911 (+ 719us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:33:30.322915 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:30.322933 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:33:30.323015 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:30.323679 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:30.323688 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:30.323697 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 23:33:30.324688 (+ 991us) client_negotiation.cc:240] Negotiation successful
0808 23:33:30.324797 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3129,"threads_started":1}
I20260808 23:33:30.326530 32670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29d1f3849c0f49f18e20dc3bf906b3ba" candidate_uuid: "52f91bd5a4e64667812bb51a377997e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2a7684e1254abeb58b1c024b7ab840"
I20260808 23:33:30.326807 32670 raft_consensus.cc:3037] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:30.326975 339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29d1f3849c0f49f18e20dc3bf906b3ba" candidate_uuid: "ad2a7684e1254abeb58b1c024b7ab840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de084f9efc2e4c9b9f2d2eb880258658" is_pre_election: true
I20260808 23:33:30.327140 32533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29d1f3849c0f49f18e20dc3bf906b3ba" candidate_uuid: "ad2a7684e1254abeb58b1c024b7ab840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f91bd5a4e64667812bb51a377997e1" is_pre_election: true
I20260808 23:33:30.327744 32533 raft_consensus.cc:2379] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2a7684e1254abeb58b1c024b7ab840 in current term 1: Already voted for candidate 52f91bd5a4e64667812bb51a377997e1 in this term.
I20260808 23:33:30.328550 340 raft_consensus.cc:2454] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f91bd5a4e64667812bb51a377997e1 in term 1.
I20260808 23:33:30.328540 32601 leader_election.cc:302] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2a7684e1254abeb58b1c024b7ab840; no voters: 52f91bd5a4e64667812bb51a377997e1, de084f9efc2e4c9b9f2d2eb880258658
I20260808 23:33:30.329010 32464 leader_election.cc:302] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52f91bd5a4e64667812bb51a377997e1, de084f9efc2e4c9b9f2d2eb880258658; no voters:
I20260808 23:33:30.329332 414 raft_consensus.cc:2781] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:30.329912 414 raft_consensus.cc:686] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [term 1 LEADER]: Becoming Leader. State: Replica: 52f91bd5a4e64667812bb51a377997e1, State: Running, Role: LEADER
I20260808 23:33:30.330495 414 consensus_queue.cc:237] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2a7684e1254abeb58b1c024b7ab840" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44677 } } peers { permanent_uuid: "de084f9efc2e4c9b9f2d2eb880258658" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36107 } } peers { permanent_uuid: "52f91bd5a4e64667812bb51a377997e1" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 39221 } }
I20260808 23:33:30.330749 32670 raft_consensus.cc:2454] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f91bd5a4e64667812bb51a377997e1 in term 1.
I20260808 23:33:30.330955 415 raft_consensus.cc:2726] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 23:33:30.335870 32385 catalog_manager.cc:5495] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52f91bd5a4e64667812bb51a377997e1 (127.26.207.193). New cstate: current_term: 1 leader_uuid: "52f91bd5a4e64667812bb51a377997e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2a7684e1254abeb58b1c024b7ab840" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de084f9efc2e4c9b9f2d2eb880258658" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52f91bd5a4e64667812bb51a377997e1" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 39221 } health_report { overall_health: HEALTHY } } }
I20260808 23:33:30.409785 406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.406278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60988 (local address 127.26.207.193:39221)
0808 23:33:30.406516 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:30.406521 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:30.407165 (+ 644us) server_negotiation.cc:407] Connection header received
0808 23:33:30.407515 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:30.407520 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:30.407624 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:30.407797 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:30.409056 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:30.409061 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:30.409064 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:30.409083 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:30.409121 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:30.409135 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:30.409273 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:30.409474 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 23:33:30.409534 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 23:33:30.419067 340 raft_consensus.cc:1261] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658 [term 1 FOLLOWER]: Refusing update from remote peer 52f91bd5a4e64667812bb51a377997e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:30.419160 32670 raft_consensus.cc:1261] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840 [term 1 FOLLOWER]: Refusing update from remote peer 52f91bd5a4e64667812bb51a377997e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:30.420197 414 consensus_queue.cc:1035] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2a7684e1254abeb58b1c024b7ab840" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:30.420579 420 consensus_queue.cc:1035] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de084f9efc2e4c9b9f2d2eb880258658" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:30.439337 426 mvcc.cc:205] Tried to move back new op lower bound from 7316406314665099264 to 7316406314318786560. Current Snapshot: MvccSnapshot[applied={T|T < 7316406314665099264}]
I20260808 23:33:30.456687 32385 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:30.457086 32385 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:30.462054 32385 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5c99fb5c560147e5b46f791d053a12c5: Sending DeleteTablet for 3 replicas of tablet 29d1f3849c0f49f18e20dc3bf906b3ba
I20260808 23:33:30.463431 32650 tablet_service.cc:1514] Processing DeleteTablet for tablet 29d1f3849c0f49f18e20dc3bf906b3ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:30 UTC) from {username='slave'} at 127.0.0.1:55088
I20260808 23:33:30.463886 319 tablet_service.cc:1514] Processing DeleteTablet for tablet 29d1f3849c0f49f18e20dc3bf906b3ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:30 UTC) from {username='slave'} at 127.0.0.1:37874
I20260808 23:33:30.464234 32512 tablet_service.cc:1514] Processing DeleteTablet for tablet 29d1f3849c0f49f18e20dc3bf906b3ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:30 UTC) from {username='slave'} at 127.0.0.1:60986
I20260808 23:33:30.467401 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 32448
I20260808 23:33:30.479516 435 tablet_replica.cc:330] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658: stopping tablet replica
I20260808 23:33:30.480090 435 raft_consensus.cc:2229] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:30.480363 433 tablet_replica.cc:330] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840: stopping tablet replica
I20260808 23:33:30.480697 435 raft_consensus.cc:2258] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:30.480831 433 raft_consensus.cc:2229] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:30.481339 433 raft_consensus.cc:2258] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:30.482118 436 tablet_replica.cc:330] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1: stopping tablet replica
I20260808 23:33:30.482546 436 raft_consensus.cc:2229] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:33:30.482762 435 ts_tablet_manager.cc:1905] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:30.483204 436 raft_consensus.cc:2258] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:30.485090 433 ts_tablet_manager.cc:1905] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:30.485582 436 ts_tablet_manager.cc:1905] T 29d1f3849c0f49f18e20dc3bf906b3ba P 52f91bd5a4e64667812bb51a377997e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:30.487208 406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.469050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60990 (local address 127.26.207.193:39221)
0808 23:33:30.469276 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:30.469283 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:30.478927 (+ 9644us) server_negotiation.cc:407] Connection header received
0808 23:33:30.479213 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:30.479222 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:30.479310 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:30.479437 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:30.485995 (+ 6558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:30.486006 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:30.486022 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:30.486052 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:30.486102 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:30.486121 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:30.486274 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:30.486801 (+ 527us) server_negotiation.cc:299] Negotiation successful
0808 23:33:30.486875 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 23:33:30.488324 32577 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:30.491413 435 ts_tablet_manager.cc:1918] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:30.491691 435 log.cc:1196] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/29d1f3849c0f49f18e20dc3bf906b3ba
I20260808 23:33:30.492357 435 ts_tablet_manager.cc:1939] T 29d1f3849c0f49f18e20dc3bf906b3ba P de084f9efc2e4c9b9f2d2eb880258658: Deleting consensus metadata
I20260808 23:33:30.493630 433 ts_tablet_manager.cc:1918] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:30.493844 433 log.cc:1196] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/29d1f3849c0f49f18e20dc3bf906b3ba
I20260808 23:33:30.494341 433 ts_tablet_manager.cc:1939] T 29d1f3849c0f49f18e20dc3bf906b3ba P ad2a7684e1254abeb58b1c024b7ab840: Deleting consensus metadata
I20260808 23:33:30.495592 32366 catalog_manager.cc:4841] TS de084f9efc2e4c9b9f2d2eb880258658 (127.26.207.195:36107): tablet 29d1f3849c0f49f18e20dc3bf906b3ba (table test-table [id=76024f808e8d4e4399215eeb3bd4e7e7]) successfully deleted
I20260808 23:33:30.496093 32369 catalog_manager.cc:4841] TS ad2a7684e1254abeb58b1c024b7ab840 (127.26.207.194:44677): tablet 29d1f3849c0f49f18e20dc3bf906b3ba (table test-table [id=76024f808e8d4e4399215eeb3bd4e7e7]) successfully deleted
I20260808 23:33:30.595716 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 32448
W20260808 23:33:30.619807 32366 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.207.193:39221 (error 108)
I20260808 23:33:30.620193 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 32586
I20260808 23:33:30.622563 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.621584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:39221 (local address 127.0.0.1:60992)
0808 23:33:30.622051 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:30.622298 (+ 247us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:39221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":216,"threads_started":1}
W20260808 23:33:30.622835 32366 catalog_manager.cc:4584] TS 52f91bd5a4e64667812bb51a377997e1 (127.26.207.193:39221): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 29d1f3849c0f49f18e20dc3bf906b3ba: Network error: Client connection negotiation failed: client connection to 127.26.207.193:39221: connect: Connection refused (error 111)
I20260808 23:33:30.623816 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.621161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55104 (local address 127.26.207.194:44677)
0808 23:33:30.621353 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:30.621358 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:30.621444 (+ 86us) server_negotiation.cc:407] Connection header received
0808 23:33:30.621663 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:30.621669 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:30.621797 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:30.621917 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:30.623088 (+ 1171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:30.623095 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:30.623100 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:30.623121 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:30.623162 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:30.623179 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:30.623326 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:30.623452 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 23:33:30.623506 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 23:33:30.624482 32714 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:30.677050 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.676369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:39221 (local address 127.0.0.1:32772)
0808 23:33:30.676669 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:30.676853 (+ 184us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:39221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260808 23:33:30.678260 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.677795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:39221 (local address 127.0.0.1:32778)
0808 23:33:30.677976 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:30.678089 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:39221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 23:33:30.719053 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 32586
I20260808 23:33:30.738976 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.738310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:39221 (local address 127.0.0.1:32792)
0808 23:33:30.738608 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:30.738748 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:39221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260808 23:33:30.740356 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.739826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:39221 (local address 127.0.0.1:32800)
0808 23:33:30.740041 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:30.740149 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:39221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 23:33:30.741472 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 32723
I20260808 23:33:30.744213 404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.742250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37880 (local address 127.26.207.195:36107)
0808 23:33:30.742434 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:30.742440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:30.742460 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:33:30.742595 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:30.742599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:30.742683 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:30.742770 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:30.743630 (+ 860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:30.743634 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:30.743637 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:30.743653 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:30.743686 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:30.743699 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:30.743796 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:30.743842 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 23:33:30.743891 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 23:33:30.745025 382 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:30.821365 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.820839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:39221 (local address 127.0.0.1:32812)
0808 23:33:30.821071 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:30.821175 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:39221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260808 23:33:30.822680 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:30.822133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:39221 (local address 127.0.0.1:32826)
0808 23:33:30.822355 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:30.822465 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:39221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260808 23:33:30.841058 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 32723
I20260808 23:33:30.863202 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 32351
I20260808 23:33:30.864732 32415 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:30.976627 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 32351
2026-08-08T23:33:31Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (3249 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 23:33:31.025203 27455 mini_oidc.cc:152] Starting JWKS server
I20260808 23:33:31.028266 27455 webserver.cc:460] Webserver started at https://127.0.0.1:32897/ using document root <none> and password file <none>
I20260808 23:33:31.028733 27455 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 23:33:31.029557 27455 webserver.cc:460] Webserver started at http://127.0.0.1:38411/ using document root <none> and password file <none>
2026-08-08T23:33:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:33:31Z Disabled control of system clock
I20260808 23:33:31.068735 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:46573
--webserver_interface=127.26.207.254
--webserver_port=0
--builtin_ntp_servers=127.26.207.212:33897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:46573
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32897/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/testchainca.cert with env {}
W20260808 23:33:31.435952 450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:31.436386 450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:31.436565 450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:31.444519 450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:33:31.444732 450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:31.444844 450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:31.444979 450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:33:31.445081 450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 23:33:31.445186 450 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 23:33:31.445272 450 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:32897/jwks.json
I20260808 23:33:31.458128 450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:33897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:46573
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:46573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32897/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:31.459756 450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:31.461369 450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:31.475634 456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:31.475732 455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:31.475765 458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:31.476661 450 server_base.cc:1034] running on GCE node
I20260808 23:33:31.477653 450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:31.479306 450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:31.480548 450 hybrid_clock.cc:648] HybridClock initialized: now 1786232011480502 us; error 41 us; skew 500 ppm
I20260808 23:33:31.481029 450 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:33:31.483682 450 webserver.cc:460] Webserver started at http://127.26.207.254:34727/ using document root <none> and password file <none>
I20260808 23:33:31.484473 450 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:31.484608 450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:31.485047 450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:31.488332 450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "3ead2453dca549d590ab5746617edd11"
format_stamp: "Formatted at 2026-08-08 23:33:31 on dist-test-slave-1x4g"
server_key: "5be2f4b07372c13f88634dedc8222673"
server_key_iv: "7eff32a7ea3e70cc78abe246e0ee003e"
server_key_version: "encryptionkey@0"
I20260808 23:33:31.489355 450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "3ead2453dca549d590ab5746617edd11"
format_stamp: "Formatted at 2026-08-08 23:33:31 on dist-test-slave-1x4g"
server_key: "5be2f4b07372c13f88634dedc8222673"
server_key_iv: "7eff32a7ea3e70cc78abe246e0ee003e"
server_key_version: "encryptionkey@0"
I20260808 23:33:31.495604 450 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 23:33:31.499819 464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:31.501631 450 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260808 23:33:31.501881 450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "3ead2453dca549d590ab5746617edd11"
format_stamp: "Formatted at 2026-08-08 23:33:31 on dist-test-slave-1x4g"
server_key: "5be2f4b07372c13f88634dedc8222673"
server_key_iv: "7eff32a7ea3e70cc78abe246e0ee003e"
server_key_version: "encryptionkey@0"
I20260808 23:33:31.502187 450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:31.527694 450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:31.528714 450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:31.529134 450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:31.549708 450 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:46573
I20260808 23:33:31.549723 516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:46573 every 8 connection(s)
I20260808 23:33:31.551237 450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:33:31.555495 517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:31.556208 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 450
I20260808 23:33:31.556456 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:33:31.557381 27455 external_mini_cluster.cc:1428] Setting key 71c8de9a5958eb15a24967c7e2080c59
I20260808 23:33:31.569873 517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11: Bootstrap starting.
I20260808 23:33:31.572506 520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:31.559704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48382 (local address 127.26.207.254:46573)
0808 23:33:31.560921 (+ 1217us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:31.560934 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:31.560985 (+ 51us) server_negotiation.cc:407] Connection header received
0808 23:33:31.562979 (+ 1994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:31.563007 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:31.563589 (+ 582us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:31.564061 (+ 472us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:31.564681 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:31.566085 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:31.567490 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:31.568232 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:31.568480 (+ 248us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:31.569828 (+ 1348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:31.569836 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:31.569852 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:31.570522 (+ 670us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:31.570610 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:31.570636 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:31.570785 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:31.571054 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 23:33:31.571405 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":392,"threads_started":1}
I20260808 23:33:31.573920 517 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:31.575417 517 log.cc:824] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:31.577320 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:33:31.578696 517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11: No bootstrap required, opened a new log
I20260808 23:33:31.587097 517 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ead2453dca549d590ab5746617edd11" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46573 } }
I20260808 23:33:31.587656 517 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:31.587792 517 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ead2453dca549d590ab5746617edd11, State: Initialized, Role: FOLLOWER
I20260808 23:33:31.588517 517 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ead2453dca549d590ab5746617edd11" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46573 } }
I20260808 23:33:31.588814 517 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:33:31.588991 517 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:33:31.589178 517 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:31.591591 517 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ead2453dca549d590ab5746617edd11" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46573 } }
I20260808 23:33:31.592226 517 leader_election.cc:302] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ead2453dca549d590ab5746617edd11; no voters:
I20260808 23:33:31.592993 517 leader_election.cc:288] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:33:31.593207 522 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:31.594198 522 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [term 1 LEADER]: Becoming Leader. State: Replica: 3ead2453dca549d590ab5746617edd11, State: Running, Role: LEADER
I20260808 23:33:31.594877 522 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ead2453dca549d590ab5746617edd11" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46573 } }
I20260808 23:33:31.595916 517 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:33:31.598165 525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ead2453dca549d590ab5746617edd11. Latest consensus state: current_term: 1 leader_uuid: "3ead2453dca549d590ab5746617edd11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ead2453dca549d590ab5746617edd11" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46573 } } }
I20260808 23:33:31.598694 525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:31.599279 524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ead2453dca549d590ab5746617edd11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ead2453dca549d590ab5746617edd11" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46573 } } }
I20260808 23:33:31.599717 524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:31.600476 532 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:33:31.606530 532 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:33:31.617131 532 catalog_manager.cc:1347] Generated new cluster ID: a9faee6e5f224c889f6e472683434756
I20260808 23:33:31.617285 532 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:33:31.656418 532 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:33:31.657965 532 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:33:31.676653 532 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ead2453dca549d590ab5746617edd11: Generated new TSK 0
I20260808 23:33:31.677785 532 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 23:33:31.733255 549 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 23:33:31.733497 549 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 23:33:31.734719 520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:31.709998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48394 (local address 127.26.207.254:46573)
0808 23:33:31.710307 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:31.710314 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:31.710856 (+ 542us) server_negotiation.cc:407] Connection header received
0808 23:33:31.711392 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:31.711398 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:31.711498 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:31.711648 (+ 150us) server_negotiation.cc:226] Negotiated authn=JWT
0808 23:33:31.712434 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:31.713358 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:31.715883 (+ 2525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:31.716462 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:31.716637 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:31.717523 (+ 886us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 23:33:31.734118 (+ 16595us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32897/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 23:33:31.734470 (+ 352us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48394: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32897/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":108}
W20260808 23:33:31.734898 520 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48394: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32897/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 23:33:31.737660 548 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:33:31.709876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:46573 (local address 127.0.0.1:48394)
0808 23:33:31.710696 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:31.710718 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:31.710945 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:31.711726 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:31.711734 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:31.711750 (+ 16us) client_negotiation.cc:189] Negotiated authn=JWT
0808 23:33:31.712188 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:31.712203 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:31.713644 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:31.713651 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:31.715620 (+ 1969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:31.715645 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:31.716770 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:31.716812 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:31.717010 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:31.717119 (+ 109us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 23:33:31.734505 (+ 17386us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32897/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 23:33:31.734948 (+ 443us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.207.254:46573: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32897/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":394,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.26.207.254:46573: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32897/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 23:33:31.739568 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 450
I20260808 23:33:31.741182 512 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:31.844709 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 450
2026-08-08T23:33:31Z chronyd exiting
I20260808 23:33:31.900856 27455 test_util.cc:175] -----------------------------------------------
I20260808 23:33:31.901046 27455 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786231963826981-27455-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (881 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 23:33:31.905215 27455 mini_oidc.cc:152] Starting JWKS server
I20260808 23:33:31.907610 27455 webserver.cc:460] Webserver started at https://127.0.0.1:37937/ using document root <none> and password file <none>
I20260808 23:33:31.907915 27455 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 23:33:31.909183 27455 webserver.cc:460] Webserver started at http://127.0.0.1:42049/ using document root <none> and password file <none>
2026-08-08T23:33:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:33:31Z Disabled control of system clock
I20260808 23:33:31.947700 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:46335
--webserver_interface=127.26.207.254
--webserver_port=0
--builtin_ntp_servers=127.26.207.212:44307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:46335
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37937/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/testchainca.cert with env {}
W20260808 23:33:32.301030 556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:32.301390 556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:32.301625 556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:32.309652 556 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:33:32.309819 556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:32.309932 556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:32.310050 556 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:33:32.310145 556 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 23:33:32.310251 556 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 23:33:32.310330 556 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37937/jwks.json
I20260808 23:33:32.321523 556 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:46335
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:46335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37937/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:32.323107 556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:32.324651 556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:32.338577 562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:32.338538 564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:32.338603 561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:32.339437 556 server_base.cc:1034] running on GCE node
I20260808 23:33:32.340396 556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:32.342201 556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:32.343482 556 hybrid_clock.cc:648] HybridClock initialized: now 1786232012343423 us; error 52 us; skew 500 ppm
I20260808 23:33:32.343892 556 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:33:32.346706 556 webserver.cc:460] Webserver started at http://127.26.207.254:46161/ using document root <none> and password file <none>
I20260808 23:33:32.347554 556 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:32.347714 556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:32.348085 556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:32.351375 556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "d3226df266484fdfb8e80160c8c6724a"
format_stamp: "Formatted at 2026-08-08 23:33:32 on dist-test-slave-1x4g"
server_key: "565f56d99a5479ba1412238e17fd060f"
server_key_iv: "1be0670a3b728bdaab539647607826bb"
server_key_version: "encryptionkey@0"
I20260808 23:33:32.352450 556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "d3226df266484fdfb8e80160c8c6724a"
format_stamp: "Formatted at 2026-08-08 23:33:32 on dist-test-slave-1x4g"
server_key: "565f56d99a5479ba1412238e17fd060f"
server_key_iv: "1be0670a3b728bdaab539647607826bb"
server_key_version: "encryptionkey@0"
I20260808 23:33:32.358628 556 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260808 23:33:32.362636 570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:32.364403 556 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 23:33:32.364673 556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "d3226df266484fdfb8e80160c8c6724a"
format_stamp: "Formatted at 2026-08-08 23:33:32 on dist-test-slave-1x4g"
server_key: "565f56d99a5479ba1412238e17fd060f"
server_key_iv: "1be0670a3b728bdaab539647607826bb"
server_key_version: "encryptionkey@0"
I20260808 23:33:32.365043 556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:32.380257 556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:32.381467 556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:32.381860 556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:32.403323 556 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:46335
I20260808 23:33:32.403343 624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:46335 every 8 connection(s)
I20260808 23:33:32.405156 556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:33:32.409659 626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:32.414336 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 556
I20260808 23:33:32.414588 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:33:32.415560 27455 external_mini_cluster.cc:1428] Setting key 7c757cf3b07e53903e3809a43dd72c25
I20260808 23:33:32.425450 626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a: Bootstrap starting.
I20260808 23:33:32.429647 626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:32.430867 626 log.cc:824] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:32.431210 629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:32.418066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47860 (local address 127.26.207.254:46335)
0808 23:33:32.419188 (+ 1122us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:32.419200 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:32.419247 (+ 47us) server_negotiation.cc:407] Connection header received
0808 23:33:32.421077 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:32.421107 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:32.421692 (+ 585us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:32.422100 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:32.422789 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:32.424174 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:32.426099 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:32.426843 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:32.427003 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:32.428480 (+ 1477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:32.428489 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:32.428504 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:32.429162 (+ 658us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:32.429260 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:32.429286 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:32.429389 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:32.429685 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 23:33:32.430045 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":669,"thread_start_us":411,"threads_started":1}
I20260808 23:33:32.434425 626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a: No bootstrap required, opened a new log
I20260808 23:33:32.435645 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:33:32.442827 626 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3226df266484fdfb8e80160c8c6724a" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46335 } }
I20260808 23:33:32.443358 626 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:32.443497 626 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3226df266484fdfb8e80160c8c6724a, State: Initialized, Role: FOLLOWER
I20260808 23:33:32.444103 626 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3226df266484fdfb8e80160c8c6724a" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46335 } }
I20260808 23:33:32.444375 626 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:33:32.444525 626 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:33:32.444703 626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:32.447047 626 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3226df266484fdfb8e80160c8c6724a" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46335 } }
I20260808 23:33:32.447630 626 leader_election.cc:302] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3226df266484fdfb8e80160c8c6724a; no voters:
I20260808 23:33:32.448321 626 leader_election.cc:288] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:33:32.448557 631 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:32.449986 631 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [term 1 LEADER]: Becoming Leader. State: Replica: d3226df266484fdfb8e80160c8c6724a, State: Running, Role: LEADER
I20260808 23:33:32.450574 631 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3226df266484fdfb8e80160c8c6724a" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46335 } }
I20260808 23:33:32.450857 626 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:33:32.453661 633 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3226df266484fdfb8e80160c8c6724a. Latest consensus state: current_term: 1 leader_uuid: "d3226df266484fdfb8e80160c8c6724a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3226df266484fdfb8e80160c8c6724a" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46335 } } }
I20260808 23:33:32.454103 633 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:32.454748 632 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3226df266484fdfb8e80160c8c6724a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3226df266484fdfb8e80160c8c6724a" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46335 } } }
I20260808 23:33:32.455132 632 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a [sys.catalog]: This master's current role is: LEADER
W20260808 23:33:32.463567 648 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 23:33:32.463716 648 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 23:33:32.463881 640 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:33:32.466254 640 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:33:32.476116 640 catalog_manager.cc:1347] Generated new cluster ID: 2f469947d3e347c5bb548e32447706b8
I20260808 23:33:32.476257 640 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:33:32.496447 640 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:33:32.498409 640 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:33:32.508363 640 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3226df266484fdfb8e80160c8c6724a: Generated new TSK 0
I20260808 23:33:32.509485 640 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 23:33:32.559942 657 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 23:33:32.560101 657 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 23:33:32.561524 629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:32.539146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47864 (local address 127.26.207.254:46335)
0808 23:33:32.539378 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:32.539386 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:32.539750 (+ 364us) server_negotiation.cc:407] Connection header received
0808 23:33:32.540003 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:32.540010 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:32.540124 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:32.540329 (+ 205us) server_negotiation.cc:226] Negotiated authn=JWT
0808 23:33:32.540849 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:32.542044 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:32.543634 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:32.544378 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:32.544545 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:32.545226 (+ 681us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 23:33:32.560730 (+ 15504us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37937/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 23:33:32.561212 (+ 482us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47864: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37937/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":95}
W20260808 23:33:32.561666 629 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47864: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37937/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 23:33:32.561688 656 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:33:32.538917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:46335 (local address 127.0.0.1:47864)
0808 23:33:32.539617 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:32.539640 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:32.539788 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:32.540351 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:32.540355 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:32.540365 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0808 23:33:32.540660 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:32.540669 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:32.542257 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:32.542262 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:32.543447 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:32.543462 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:32.544587 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:32.544593 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:32.544762 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:32.544888 (+ 126us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 23:33:32.561072 (+ 16184us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37937/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 23:33:32.561313 (+ 241us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.207.254:46335: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37937/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":370,"threads_started":1}
I20260808 23:33:32.562752 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 556
I20260808 23:33:32.564150 620 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:32.678097 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 556
2026-08-08T23:33:32Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (834 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 23:33:32.739961 27455 mini_oidc.cc:152] Starting JWKS server
I20260808 23:33:32.742254 27455 webserver.cc:460] Webserver started at https://127.0.0.1:34935/ using document root <none> and password file <none>
I20260808 23:33:32.742520 27455 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 23:33:32.743261 27455 webserver.cc:460] Webserver started at http://127.0.0.1:39791/ using document root <none> and password file <none>
2026-08-08T23:33:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:33:32Z Disabled control of system clock
I20260808 23:33:32.784300 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:36061
--webserver_interface=127.26.207.254
--webserver_port=0
--builtin_ntp_servers=127.26.207.212:42443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:36061
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34935/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 23:33:33.162123 665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:33.162513 665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:33.162676 665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:33.170403 665 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:33:33.170583 665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:33.170750 665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:33.170859 665 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:33:33.170974 665 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 23:33:33.171126 665 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 23:33:33.171208 665 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34935/jwks.json
I20260808 23:33:33.182267 665 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:42443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:36061
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:36061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34935/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:33.183815 665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:33.186340 665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:33.200621 670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:33.200680 671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:33.200572 673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:33.206848 665 server_base.cc:1034] running on GCE node
I20260808 23:33:33.207866 665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:33.209741 665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:33.211088 665 hybrid_clock.cc:648] HybridClock initialized: now 1786232013211008 us; error 84 us; skew 500 ppm
I20260808 23:33:33.211611 665 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:33:33.214511 665 webserver.cc:460] Webserver started at http://127.26.207.254:45367/ using document root <none> and password file <none>
I20260808 23:33:33.215306 665 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:33.215410 665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:33.215729 665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:33.219286 665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "d79ff6e4030b40aab74694d469c17f15"
format_stamp: "Formatted at 2026-08-08 23:33:33 on dist-test-slave-1x4g"
server_key: "4cee7abde349e32abb97197fce244034"
server_key_iv: "dbb19c9453498c1dd8f7c6d5482105bc"
server_key_version: "encryptionkey@0"
I20260808 23:33:33.220263 665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "d79ff6e4030b40aab74694d469c17f15"
format_stamp: "Formatted at 2026-08-08 23:33:33 on dist-test-slave-1x4g"
server_key: "4cee7abde349e32abb97197fce244034"
server_key_iv: "dbb19c9453498c1dd8f7c6d5482105bc"
server_key_version: "encryptionkey@0"
I20260808 23:33:33.226639 665 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.002s
I20260808 23:33:33.230829 679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:33.232641 665 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260808 23:33:33.232926 665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "d79ff6e4030b40aab74694d469c17f15"
format_stamp: "Formatted at 2026-08-08 23:33:33 on dist-test-slave-1x4g"
server_key: "4cee7abde349e32abb97197fce244034"
server_key_iv: "dbb19c9453498c1dd8f7c6d5482105bc"
server_key_version: "encryptionkey@0"
I20260808 23:33:33.233206 665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:33.248989 665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:33.250304 665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:33.250707 665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:33.271781 665 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:36061
I20260808 23:33:33.271806 733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:36061 every 8 connection(s)
I20260808 23:33:33.273481 665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:33:33.277819 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:33.283571 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 665
I20260808 23:33:33.283826 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:33:33.284495 27455 external_mini_cluster.cc:1428] Setting key 66c45097c963c90091bd3355e40e6a1e
I20260808 23:33:33.290136 734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15: Bootstrap starting.
I20260808 23:33:33.294152 734 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:33.295684 734 log.cc:824] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:33.299963 734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15: No bootstrap required, opened a new log
I20260808 23:33:33.301860 737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:33.286796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51634 (local address 127.26.207.254:36061)
0808 23:33:33.288092 (+ 1296us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:33.288106 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:33.288174 (+ 68us) server_negotiation.cc:407] Connection header received
0808 23:33:33.290500 (+ 2326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:33.290528 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:33.291060 (+ 532us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:33.291424 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:33.292185 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:33.293619 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:33.295791 (+ 2172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:33.297179 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:33.297433 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:33.299098 (+ 1665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:33.299106 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:33.299123 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:33.299745 (+ 622us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:33.299835 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:33.299860 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:33.299969 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:33.300323 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 23:33:33.300746 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":733,"thread_start_us":490,"threads_started":1}
I20260808 23:33:33.306260 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:33:33.308959 734 raft_consensus.cc:348] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d79ff6e4030b40aab74694d469c17f15" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36061 } }
I20260808 23:33:33.309434 734 raft_consensus.cc:374] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:33.309568 734 raft_consensus.cc:729] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79ff6e4030b40aab74694d469c17f15, State: Initialized, Role: FOLLOWER
I20260808 23:33:33.310292 734 consensus_queue.cc:260] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d79ff6e4030b40aab74694d469c17f15" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36061 } }
I20260808 23:33:33.310568 734 raft_consensus.cc:388] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:33:33.310731 734 raft_consensus.cc:482] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:33:33.310941 734 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:33.313397 734 raft_consensus.cc:504] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d79ff6e4030b40aab74694d469c17f15" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36061 } }
I20260808 23:33:33.313999 734 leader_election.cc:302] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d79ff6e4030b40aab74694d469c17f15; no voters:
I20260808 23:33:33.314644 734 leader_election.cc:288] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:33:33.314832 739 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:33.316826 739 raft_consensus.cc:686] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [term 1 LEADER]: Becoming Leader. State: Replica: d79ff6e4030b40aab74694d469c17f15, State: Running, Role: LEADER
I20260808 23:33:33.317369 734 sys_catalog.cc:564] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:33:33.317610 739 consensus_queue.cc:237] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d79ff6e4030b40aab74694d469c17f15" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36061 } }
I20260808 23:33:33.320704 741 sys_catalog.cc:455] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d79ff6e4030b40aab74694d469c17f15. Latest consensus state: current_term: 1 leader_uuid: "d79ff6e4030b40aab74694d469c17f15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d79ff6e4030b40aab74694d469c17f15" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36061 } } }
I20260808 23:33:33.320945 740 sys_catalog.cc:455] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d79ff6e4030b40aab74694d469c17f15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d79ff6e4030b40aab74694d469c17f15" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36061 } } }
I20260808 23:33:33.321254 741 sys_catalog.cc:458] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:33.321260 740 sys_catalog.cc:458] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:33.322395 749 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:33:33.328716 749 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:33:33.339818 749 catalog_manager.cc:1347] Generated new cluster ID: 8432f0f9ce0a49ba9c05491167317f41
I20260808 23:33:33.339968 749 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:33:33.357445 749 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:33:33.358974 749 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:33:33.370086 749 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d79ff6e4030b40aab74694d469c17f15: Generated new TSK 0
I20260808 23:33:33.371107 749 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:33:33.397523 737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:33.387728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51640 (local address 127.26.207.254:36061)
0808 23:33:33.387961 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:33.387968 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:33.388289 (+ 321us) server_negotiation.cc:407] Connection header received
0808 23:33:33.388556 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:33.388562 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:33.388667 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:33.388871 (+ 204us) server_negotiation.cc:226] Negotiated authn=JWT
0808 23:33:33.389430 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:33.390610 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:33.392162 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:33.392960 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:33.393113 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:33.393911 (+ 798us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 23:33:33.396695 (+ 2784us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34935/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 23:33:33.397154 (+ 459us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51640: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34935/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":93}
W20260808 23:33:33.397691 737 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51640: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34935/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 23:33:33.399200 764 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:33:33.387486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36061 (local address 127.0.0.1:51640)
0808 23:33:33.388166 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:33.388184 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:33.388325 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:33.388927 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:33.388931 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:33.388942 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0808 23:33:33.389266 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:33.389274 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:33.390789 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:33.390793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:33.391992 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:33.392006 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:33.393229 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:33.393237 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:33.393480 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:33.393537 (+ 57us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 23:33:33.398045 (+ 4508us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34935/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 23:33:33.398743 (+ 698us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.207.254:36061: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34935/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":526,"mutex_wait_us":315,"thread_start_us":367,"threads_started":1}
I20260808 23:33:33.400358 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 665
I20260808 23:33:33.401721 727 generic_service.cc:196] Checking for leaks (request via RPC)
E20260808 23:33:33.409571 765 webserver.cc:533] Webserver: sslize failed:
E20260808 23:33:33.409689 765 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 23:33:33.496716 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 665
2026-08-08T23:33:33Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (818 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T23:33:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:33:33Z Disabled control of system clock
I20260808 23:33:33.598976 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:33331
--webserver_interface=127.26.207.254
--webserver_port=0
--builtin_ntp_servers=127.26.207.212:40027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:33331
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/testchainca.cert with env {}
W20260808 23:33:33.961402 770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:33.961861 770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:33.961967 770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:33.969633 770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:33:33.969765 770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:33.969803 770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:33.969856 770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:33:33.969902 770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 23:33:33.969960 770 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 23:33:33.970000 770 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 23:33:33.980701 770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:40027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:33331
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:33331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:33.982180 770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:33.983553 770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:33.997223 775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:33.997190 776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:33.997139 778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:33.998204 770 server_base.cc:1034] running on GCE node
I20260808 23:33:33.999130 770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:34.000762 770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:34.002071 770 hybrid_clock.cc:648] HybridClock initialized: now 1786232014002007 us; error 61 us; skew 500 ppm
I20260808 23:33:34.002496 770 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:33:34.005254 770 webserver.cc:460] Webserver started at http://127.26.207.254:44153/ using document root <none> and password file <none>
I20260808 23:33:34.006145 770 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:34.006278 770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:34.006629 770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:34.009897 770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "24a0424089f94e8bb7e36937eb85594b"
format_stamp: "Formatted at 2026-08-08 23:33:34 on dist-test-slave-1x4g"
server_key: "8171b9da2fa42bfa04de50d49e7ed944"
server_key_iv: "da46d3b710688fc4c97c1b432dd9b7b6"
server_key_version: "encryptionkey@0"
I20260808 23:33:34.010831 770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "24a0424089f94e8bb7e36937eb85594b"
format_stamp: "Formatted at 2026-08-08 23:33:34 on dist-test-slave-1x4g"
server_key: "8171b9da2fa42bfa04de50d49e7ed944"
server_key_iv: "da46d3b710688fc4c97c1b432dd9b7b6"
server_key_version: "encryptionkey@0"
I20260808 23:33:34.016592 770 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 23:33:34.020423 784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:34.022104 770 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:33:34.022351 770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "24a0424089f94e8bb7e36937eb85594b"
format_stamp: "Formatted at 2026-08-08 23:33:34 on dist-test-slave-1x4g"
server_key: "8171b9da2fa42bfa04de50d49e7ed944"
server_key_iv: "da46d3b710688fc4c97c1b432dd9b7b6"
server_key_version: "encryptionkey@0"
I20260808 23:33:34.022668 770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:34.055893 770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:34.056993 770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:34.057339 770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:34.077806 770 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:33331
I20260808 23:33:34.077833 840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:33331 every 8 connection(s)
I20260808 23:33:34.079330 770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:33:34.083530 841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:34.087971 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 770
I20260808 23:33:34.088208 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:33:34.089015 27455 external_mini_cluster.cc:1428] Setting key ab5b93f0058e01d02ef47afeb454f36e
I20260808 23:33:34.096031 841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b: Bootstrap starting.
I20260808 23:33:34.100045 841 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:34.101372 841 log.cc:824] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:34.105090 844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:34.091175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46252 (local address 127.26.207.254:33331)
0808 23:33:34.092349 (+ 1174us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:34.092362 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:34.092425 (+ 63us) server_negotiation.cc:407] Connection header received
0808 23:33:34.094451 (+ 2026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:34.094485 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:34.095058 (+ 573us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:34.095534 (+ 476us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:34.096238 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:34.097741 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:34.099398 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:34.100222 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:34.100455 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:34.101859 (+ 1404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:34.101871 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:34.101900 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:33:34.102669 (+ 769us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:34.102763 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:33:34.102790 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:34.102982 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:34.103245 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 23:33:34.103651 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":688,"thread_start_us":412,"threads_started":1}
I20260808 23:33:34.105456 841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b: No bootstrap required, opened a new log
I20260808 23:33:34.110184 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:33:34.114681 841 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a0424089f94e8bb7e36937eb85594b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 33331 } }
I20260808 23:33:34.115170 841 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:34.115280 841 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a0424089f94e8bb7e36937eb85594b, State: Initialized, Role: FOLLOWER
I20260808 23:33:34.116050 841 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a0424089f94e8bb7e36937eb85594b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 33331 } }
I20260808 23:33:34.116343 841 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:33:34.116518 841 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:33:34.116731 841 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:34.119160 841 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a0424089f94e8bb7e36937eb85594b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 33331 } }
I20260808 23:33:34.119774 841 leader_election.cc:302] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24a0424089f94e8bb7e36937eb85594b; no voters:
I20260808 23:33:34.120427 841 leader_election.cc:288] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:33:34.120594 846 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:34.121405 846 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [term 1 LEADER]: Becoming Leader. State: Replica: 24a0424089f94e8bb7e36937eb85594b, State: Running, Role: LEADER
I20260808 23:33:34.122049 846 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a0424089f94e8bb7e36937eb85594b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 33331 } }
I20260808 23:33:34.122741 841 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:33:34.125236 848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24a0424089f94e8bb7e36937eb85594b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a0424089f94e8bb7e36937eb85594b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 33331 } } }
I20260808 23:33:34.125710 848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:34.126498 849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24a0424089f94e8bb7e36937eb85594b. Latest consensus state: current_term: 1 leader_uuid: "24a0424089f94e8bb7e36937eb85594b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a0424089f94e8bb7e36937eb85594b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 33331 } } }
I20260808 23:33:34.126883 849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:34.127605 855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:33:34.134070 855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:33:34.144357 855 catalog_manager.cc:1347] Generated new cluster ID: 3f34e970f25947e2af962e4a64e6924c
I20260808 23:33:34.144517 855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:33:34.179652 855 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:33:34.181517 855 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:33:34.193480 855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24a0424089f94e8bb7e36937eb85594b: Generated new TSK 0
I20260808 23:33:34.194705 855 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:33:34.238508 844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:34.215683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46258 (local address 127.26.207.254:33331)
0808 23:33:34.215967 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:34.215973 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:34.216406 (+ 433us) server_negotiation.cc:407] Connection header received
0808 23:33:34.216692 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:34.216696 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:34.216849 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:34.217003 (+ 154us) server_negotiation.cc:226] Negotiated authn=JWT
0808 23:33:34.217568 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:34.218327 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:34.220476 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:34.221039 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:34.221143 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:34.221804 (+ 661us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 23:33:34.237641 (+ 15837us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 23:33:34.238154 (+ 513us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46258: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":87}
W20260808 23:33:34.238673 844 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46258: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 23:33:34.238657 871 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:33:34.215542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:33331 (local address 127.0.0.1:46258)
0808 23:33:34.216278 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:34.216299 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:34.216473 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:34.217063 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:34.217068 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:34.217082 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0808 23:33:34.217402 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:34.217415 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:34.218492 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:34.218498 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:34.220296 (+ 1798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:34.220314 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:34.221234 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:34.221241 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:34.221447 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:34.221499 (+ 52us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 23:33:34.238011 (+ 16512us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 23:33:34.238285 (+ 274us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.207.254:33331: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":385,"threads_started":1}
I20260808 23:33:34.240477 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 770
I20260808 23:33:34.241958 834 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:34.340013 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 770
2026-08-08T23:33:34Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (821 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (446 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (1643 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:33:36 dist-test-slave-1x4g krb5kdc[887](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:33:36 dist-test-slave-1x4g krb5kdc[887](info): set up 2 sockets
Aug 08 23:33:36 dist-test-slave-1x4g krb5kdc[887](info): commencing operation
krb5kdc: starting...
W20260808 23:33:37.590811 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:33:37 dist-test-slave-1x4g krb5kdc[887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232017, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:33:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:33:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:33:37.878602 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:38465
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:36649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:38465
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:38.244131 901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:38.244477 901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:38.244648 901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:38.252449 901 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:33:38.252588 901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:38.252679 901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:38.252820 901 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:33:38.252887 901 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:33:38.263957 901 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:36649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:38465
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:38465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:38.265627 901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:38.267104 901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:38.280869 906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:38.280833 909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:38.280872 907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:38.281948 901 server_base.cc:1034] running on GCE node
I20260808 23:33:38.282938 901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:38.284672 901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:38.285939 901 hybrid_clock.cc:648] HybridClock initialized: now 1786232018285894 us; error 49 us; skew 500 ppm
I20260808 23:33:38.286360 901 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:38 dist-test-slave-1x4g krb5kdc[887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232018, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:38.290544 901 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:33:38.292721 901 webserver.cc:460] Webserver started at http://127.26.207.254:44555/ using document root <none> and password file <none>
I20260808 23:33:38.293689 901 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:38.293882 901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:38.294287 901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:38.297966 901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "36162efe4f294217be804dbd4b02abba"
format_stamp: "Formatted at 2026-08-08 23:33:38 on dist-test-slave-1x4g"
server_key: "2128f424b28e7077ed2cae4696f07b92"
server_key_iv: "bdfb46971c2313e555885bbb9b0e49ab"
server_key_version: "encryptionkey@0"
I20260808 23:33:38.299261 901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "36162efe4f294217be804dbd4b02abba"
format_stamp: "Formatted at 2026-08-08 23:33:38 on dist-test-slave-1x4g"
server_key: "2128f424b28e7077ed2cae4696f07b92"
server_key_iv: "bdfb46971c2313e555885bbb9b0e49ab"
server_key_version: "encryptionkey@0"
I20260808 23:33:38.306128 901 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 23:33:38.310707 917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:38.312520 901 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 23:33:38.312884 901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "36162efe4f294217be804dbd4b02abba"
format_stamp: "Formatted at 2026-08-08 23:33:38 on dist-test-slave-1x4g"
server_key: "2128f424b28e7077ed2cae4696f07b92"
server_key_iv: "bdfb46971c2313e555885bbb9b0e49ab"
server_key_version: "encryptionkey@0"
I20260808 23:33:38.313156 901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:38.332085 901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:38.337455 901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:38.337839 901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:38.359059 901 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:38465
I20260808 23:33:38.359107 971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:38465 every 8 connection(s)
I20260808 23:33:38.360860 901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:33:38.365597 973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:38.368021 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 901
I20260808 23:33:38.368325 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:33:38.369340 27455 external_mini_cluster.cc:1428] Setting key 0b02de0e98a45a5dc706846cbcda51b8
I20260808 23:33:38.381383 973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba: Bootstrap starting.
I20260808 23:33:38.386112 973 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba: Neither blocks nor log segments found. Creating new log.
Aug 08 23:33:38 dist-test-slave-1x4g krb5kdc[887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232017, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:38.387456 973 log.cc:824] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:38.391901 973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba: No bootstrap required, opened a new log
I20260808 23:33:38.398451 977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:38.372018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46220 (local address 127.26.207.254:38465)
0808 23:33:38.373014 (+ 996us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:38.373030 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:38.373079 (+ 49us) server_negotiation.cc:407] Connection header received
0808 23:33:38.375146 (+ 2067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:38.375174 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:38.375624 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:38.375990 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:38.378216 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:38.379696 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:38.381706 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:38.382637 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:38.382816 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:38.388390 (+ 5574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:38.388403 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:38.388422 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:38.388465 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:38.392650 (+ 4185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:38.393666 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:38.393676 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:38.393686 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:38.393931 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:38.394479 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:38.394484 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:38.394487 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:38.395370 (+ 883us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:38.395788 (+ 418us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:38.396262 (+ 474us) server_negotiation.cc:299] Negotiation successful
0808 23:33:38.396876 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":713,"thread_start_us":463,"threads_started":1}
I20260808 23:33:38.402355 973 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36162efe4f294217be804dbd4b02abba" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38465 } }
I20260808 23:33:38.402758 973 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:38.402835 973 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36162efe4f294217be804dbd4b02abba, State: Initialized, Role: FOLLOWER
I20260808 23:33:38.403469 973 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36162efe4f294217be804dbd4b02abba" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38465 } }
I20260808 23:33:38.403841 973 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:33:38.404008 973 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:33:38.404186 973 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:38.406889 973 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36162efe4f294217be804dbd4b02abba" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38465 } }
I20260808 23:33:38.407570 973 leader_election.cc:302] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36162efe4f294217be804dbd4b02abba; no voters:
I20260808 23:33:38.408349 973 leader_election.cc:288] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:33:38.408398 979 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:38.409441 979 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [term 1 LEADER]: Becoming Leader. State: Replica: 36162efe4f294217be804dbd4b02abba, State: Running, Role: LEADER
I20260808 23:33:38.410130 979 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36162efe4f294217be804dbd4b02abba" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38465 } }
I20260808 23:33:38.410935 973 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:33:38.413313 981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36162efe4f294217be804dbd4b02abba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36162efe4f294217be804dbd4b02abba" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38465 } } }
I20260808 23:33:38.413844 981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:38.415113 980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36162efe4f294217be804dbd4b02abba. Latest consensus state: current_term: 1 leader_uuid: "36162efe4f294217be804dbd4b02abba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36162efe4f294217be804dbd4b02abba" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38465 } } }
I20260808 23:33:38.417140 980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:38.419054 985 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:33:38.425410 985 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:33:38.435039 985 catalog_manager.cc:1347] Generated new cluster ID: 9141a535034e4dfdbc312f89dcdd4463
I20260808 23:33:38.435176 985 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:33:38.451844 985 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:33:38.453979 985 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:33:38.472537 985 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36162efe4f294217be804dbd4b02abba: Generated new TSK 0
I20260808 23:33:38.473850 985 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:33:38.541251 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38465
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:36649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:38.919767 1003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:38.920078 1003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:38.920177 1003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:38.928395 1003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:38.928514 1003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:38.928637 1003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:33:38.939184 1003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:36649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38465
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:38.940587 1003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:38.942065 1003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:38.957073 1008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:38.957055 1009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:38.957024 1011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:38.957947 1003 server_base.cc:1034] running on GCE node
I20260808 23:33:38.958745 1003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:38.959851 1003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:38.961119 1003 hybrid_clock.cc:648] HybridClock initialized: now 1786232018961062 us; error 41 us; skew 500 ppm
I20260808 23:33:38.961499 1003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:38 dist-test-slave-1x4g krb5kdc[887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232018, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:38.965224 1003 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:33:38.967065 1003 webserver.cc:460] Webserver started at http://127.26.207.193:34499/ using document root <none> and password file <none>
I20260808 23:33:38.967880 1003 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:38.968053 1003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:38.968510 1003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:38.972555 1003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "e199c46024cd4e09b0362f16bef36fd7"
format_stamp: "Formatted at 2026-08-08 23:33:38 on dist-test-slave-1x4g"
server_key: "c4b2502d62cab7d09811ba8979a1e19e"
server_key_iv: "dd5a2f9e6572f1238140d40849862227"
server_key_version: "encryptionkey@0"
I20260808 23:33:38.973645 1003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "e199c46024cd4e09b0362f16bef36fd7"
format_stamp: "Formatted at 2026-08-08 23:33:38 on dist-test-slave-1x4g"
server_key: "c4b2502d62cab7d09811ba8979a1e19e"
server_key_iv: "dd5a2f9e6572f1238140d40849862227"
server_key_version: "encryptionkey@0"
I20260808 23:33:38.980100 1003 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 23:33:38.984280 1019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:38.985945 1003 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:33:38.986188 1003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "e199c46024cd4e09b0362f16bef36fd7"
format_stamp: "Formatted at 2026-08-08 23:33:38 on dist-test-slave-1x4g"
server_key: "c4b2502d62cab7d09811ba8979a1e19e"
server_key_iv: "dd5a2f9e6572f1238140d40849862227"
server_key_version: "encryptionkey@0"
I20260808 23:33:38.986461 1003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:39.020816 1003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:39.025766 1003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:39.026157 1003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:39.027366 1003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:39.028940 1003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:39.029057 1003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:39.029218 1003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:39.029305 1003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:39.066628 1003 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:34389
I20260808 23:33:39.066675 1138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:34389 every 8 connection(s)
I20260808 23:33:39.068148 1003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:33:39.070910 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 1003
I20260808 23:33:39.071149 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:33:39.072034 27455 external_mini_cluster.cc:1428] Setting key ee987a0748e09dfab23b90a3538bcbb4
Aug 08 23:33:39 dist-test-slave-1x4g krb5kdc[887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232018, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:39.092943 1141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:39.071204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:53429 (local address 127.26.207.254:38465)
0808 23:33:39.071775 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:39.071781 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:39.073074 (+ 1293us) server_negotiation.cc:407] Connection header received
0808 23:33:39.075143 (+ 2069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:39.075149 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:39.075248 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:39.075374 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:39.077109 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:39.078272 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:39.079984 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:39.080721 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:39.080906 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:39.085088 (+ 4182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:39.085098 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:39.085104 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:39.085159 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:39.088259 (+ 3100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:39.089532 (+ 1273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:39.089537 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:39.089540 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:39.089703 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:39.090493 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:39.090504 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:39.090506 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:39.090941 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:39.091105 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:39.092299 (+ 1194us) server_negotiation.cc:299] Negotiation successful
0808 23:33:39.092554 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":266,"threads_started":1}
I20260808 23:33:39.094542 1142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:39.071915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:38465 (local address 127.26.207.193:53429)
0808 23:33:39.072900 (+ 985us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:39.072952 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:39.074825 (+ 1873us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:39.075634 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:39.075643 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:39.076204 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:39.076912 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:39.076935 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:39.078483 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:39.078488 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:39.079813 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:39.079826 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:39.080999 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:39.081006 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:39.081235 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:39.081992 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:39.082018 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:39.084711 (+ 2693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:39.088477 (+ 3766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:39.088491 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:39.088514 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:39.089339 (+ 825us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:39.089856 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:39.089863 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:39.089870 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:39.090272 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:39.091119 (+ 847us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:39.091131 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:39.091698 (+ 567us) client_negotiation.cc:769] Sending connection context
0808 23:33:39.092110 (+ 412us) client_negotiation.cc:240] Negotiation successful
0808 23:33:39.092851 (+ 741us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"thread_start_us":432,"threads_started":1}
I20260808 23:33:39.096483 1139 heartbeater.cc:347] Connected to a master server at 127.26.207.254:38465
I20260808 23:33:39.097003 1139 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:39.097916 1139 heartbeater.cc:511] Master 127.26.207.254:38465 requested a full tablet report, sending...
I20260808 23:33:39.100461 935 ts_manager.cc:194] Registered new tserver with Master: e199c46024cd4e09b0362f16bef36fd7 (127.26.207.193:34389)
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
I20260808 23:33:39.102370 935 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:53429
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:33:39.136747 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38465
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:36649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:39.505126 1145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:39.505496 1145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:39.505689 1145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:39.513584 1145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:39.513761 1145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:39.513952 1145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:33:39.524682 1145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:36649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38465
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:39.526209 1145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:39.527580 1145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:39.541712 1150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:39.541766 1151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:39.542001 1153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:39.542811 1145 server_base.cc:1034] running on GCE node
I20260808 23:33:39.543598 1145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:39.544657 1145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:39.545917 1145 hybrid_clock.cc:648] HybridClock initialized: now 1786232019545868 us; error 74 us; skew 500 ppm
I20260808 23:33:39.546324 1145 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:39 dist-test-slave-1x4g krb5kdc[887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232019, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:39.549716 1145 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:33:39.551407 1145 webserver.cc:460] Webserver started at http://127.26.207.194:39815/ using document root <none> and password file <none>
I20260808 23:33:39.552160 1145 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:39.552274 1145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:39.552554 1145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:39.555935 1145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "e0c6c1cc1c464dbda5b62cbfbeb4ee08"
format_stamp: "Formatted at 2026-08-08 23:33:39 on dist-test-slave-1x4g"
server_key: "6584bb6756641c919c07eb2b938f1ce9"
server_key_iv: "c288d6ccda7a66f75abb5a77782d1a87"
server_key_version: "encryptionkey@0"
I20260808 23:33:39.556874 1145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "e0c6c1cc1c464dbda5b62cbfbeb4ee08"
format_stamp: "Formatted at 2026-08-08 23:33:39 on dist-test-slave-1x4g"
server_key: "6584bb6756641c919c07eb2b938f1ce9"
server_key_iv: "c288d6ccda7a66f75abb5a77782d1a87"
server_key_version: "encryptionkey@0"
I20260808 23:33:39.562670 1145 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 23:33:39.566774 1160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:39.568485 1145 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 23:33:39.568660 1145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "e0c6c1cc1c464dbda5b62cbfbeb4ee08"
format_stamp: "Formatted at 2026-08-08 23:33:39 on dist-test-slave-1x4g"
server_key: "6584bb6756641c919c07eb2b938f1ce9"
server_key_iv: "c288d6ccda7a66f75abb5a77782d1a87"
server_key_version: "encryptionkey@0"
I20260808 23:33:39.568948 1145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:39.589808 1145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:39.594910 1145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:39.595192 1145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:39.596187 1145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:39.597640 1145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:39.597720 1145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:39.597810 1145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:39.597853 1145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:39.634078 1145 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:46005
I20260808 23:33:39.634126 1275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:46005 every 8 connection(s)
I20260808 23:33:39.635469 1145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:33:39.645682 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 1145
I20260808 23:33:39.645893 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:33:39.646382 27455 external_mini_cluster.cc:1428] Setting key 4fae914d7c4e36bbb62dc101b9a536c3
Aug 08 23:33:39 dist-test-slave-1x4g krb5kdc[887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232019, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:39.658248 1278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:39.638369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:59131 (local address 127.26.207.254:38465)
0808 23:33:39.638882 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:39.638889 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:39.640025 (+ 1136us) server_negotiation.cc:407] Connection header received
0808 23:33:39.642090 (+ 2065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:39.642095 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:39.642174 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:39.642290 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:39.643986 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:39.644756 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:39.646688 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:39.647281 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:39.647459 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:39.651745 (+ 4286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:39.651752 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:39.651755 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:39.651794 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:39.654587 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:39.655508 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:39.655514 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:39.655518 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:39.655676 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:39.656178 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:39.656183 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:39.656188 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:39.656495 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:39.656679 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:39.657562 (+ 883us) server_negotiation.cc:299] Negotiation successful
0808 23:33:39.657837 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":239,"threads_started":1}
I20260808 23:33:39.659379 1279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:39.639024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:38465 (local address 127.26.207.194:59131)
0808 23:33:39.639828 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:39.639872 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:39.641774 (+ 1902us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:39.642529 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:39.642538 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:39.643138 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:39.643759 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:39.643778 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:39.644989 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:39.644993 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:39.646468 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:39.646507 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:39.647576 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:39.647587 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:39.647852 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:39.648664 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:39.648695 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:39.651446 (+ 2751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:39.654783 (+ 3337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:39.654795 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:39.654823 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:39.655350 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:39.655807 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:39.655812 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:39.655816 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:39.656045 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:39.656653 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:39.656663 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:39.657150 (+ 487us) client_negotiation.cc:769] Sending connection context
0808 23:33:39.657473 (+ 323us) client_negotiation.cc:240] Negotiation successful
0808 23:33:39.658112 (+ 639us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":316,"threads_started":1}
I20260808 23:33:39.661136 1276 heartbeater.cc:347] Connected to a master server at 127.26.207.254:38465
I20260808 23:33:39.661500 1276 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:39.662293 1276 heartbeater.cc:511] Master 127.26.207.254:38465 requested a full tablet report, sending...
I20260808 23:33:39.664038 935 ts_manager.cc:194] Registered new tserver with Master: e0c6c1cc1c464dbda5b62cbfbeb4ee08 (127.26.207.194:46005)
I20260808 23:33:39.665457 935 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:59131
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:33:39.710448 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38465
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:36649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:40.067667 1283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:40.068060 1283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:40.068202 1283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:40.077947 1283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:40.078143 1283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:40.078354 1283 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:33:40.089401 1283 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:36649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38465
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:40.090989 1283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:40.092537 1283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 23:33:40.106680 1139 heartbeater.cc:503] Master 127.26.207.254:38465 was elected leader, sending a full tablet report...
W20260808 23:33:40.109650 1292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:40.109912 1290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:40.110092 1289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:40.110275 1283 server_base.cc:1034] running on GCE node
I20260808 23:33:40.111469 1283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:40.112679 1283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:40.114001 1283 hybrid_clock.cc:648] HybridClock initialized: now 1786232020113914 us; error 73 us; skew 500 ppm
I20260808 23:33:40.114432 1283 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232020, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:40.118366 1283 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:33:40.120285 1283 webserver.cc:460] Webserver started at http://127.26.207.195:38141/ using document root <none> and password file <none>
I20260808 23:33:40.121206 1283 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:40.121387 1283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:40.121750 1283 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:40.125205 1283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "b91a7572764c4324893880645cf285f6"
format_stamp: "Formatted at 2026-08-08 23:33:40 on dist-test-slave-1x4g"
server_key: "8133dc39c97ab22db36a467dda937685"
server_key_iv: "8d45df6508560566fa0036e6e13017a4"
server_key_version: "encryptionkey@0"
I20260808 23:33:40.126124 1283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "b91a7572764c4324893880645cf285f6"
format_stamp: "Formatted at 2026-08-08 23:33:40 on dist-test-slave-1x4g"
server_key: "8133dc39c97ab22db36a467dda937685"
server_key_iv: "8d45df6508560566fa0036e6e13017a4"
server_key_version: "encryptionkey@0"
I20260808 23:33:40.132264 1283 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 23:33:40.136590 1299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:40.138360 1283 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:33:40.138582 1283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "b91a7572764c4324893880645cf285f6"
format_stamp: "Formatted at 2026-08-08 23:33:40 on dist-test-slave-1x4g"
server_key: "8133dc39c97ab22db36a467dda937685"
server_key_iv: "8d45df6508560566fa0036e6e13017a4"
server_key_version: "encryptionkey@0"
I20260808 23:33:40.138839 1283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:40.171808 1283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:40.176976 1283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:40.177322 1283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:40.178454 1283 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:40.179924 1283 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:40.180004 1283 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:40.180114 1283 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:40.180160 1283 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:40.220552 1283 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:38303
I20260808 23:33:40.220606 1423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:38303 every 8 connection(s)
I20260808 23:33:40.222038 1283 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:33:40.229270 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 1283
I20260808 23:33:40.229485 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:33:40.230099 27455 external_mini_cluster.cc:1428] Setting key ab19f613e350980799406c57f0b95caf
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232020, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:33:40.246089 1426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:40.224993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:54981 (local address 127.26.207.254:38465)
0808 23:33:40.225459 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:40.225464 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:40.226846 (+ 1382us) server_negotiation.cc:407] Connection header received
0808 23:33:40.228861 (+ 2015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:40.228866 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:40.228964 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:40.229069 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:40.231589 (+ 2520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:40.232634 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:40.234653 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:40.235063 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:40.235173 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:40.239092 (+ 3919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:40.239099 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:40.239102 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:40.239141 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:40.242062 (+ 2921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:40.243069 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:40.243075 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:40.243078 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:40.243243 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:40.243844 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:40.243849 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:40.243851 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:40.244244 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:40.244407 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:40.245472 (+ 1065us) server_negotiation.cc:299] Negotiation successful
0808 23:33:40.245722 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":223,"threads_started":1}
I20260808 23:33:40.247401 1427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:40.225835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:38465 (local address 127.26.207.195:54981)
0808 23:33:40.226646 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:40.226696 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:40.228469 (+ 1773us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:40.229402 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:40.229416 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:40.230442 (+ 1026us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:40.231367 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:40.231401 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:40.232862 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:40.232866 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:40.234498 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:40.234514 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:40.235283 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:40.235288 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:40.235507 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:40.236272 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:40.236307 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:40.238804 (+ 2497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:40.242244 (+ 3440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:40.242253 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:40.242269 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:40.242879 (+ 610us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:40.243399 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:40.243403 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:40.243405 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:40.243669 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:40.244428 (+ 759us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:40.244437 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:40.244962 (+ 525us) client_negotiation.cc:769] Sending connection context
0808 23:33:40.245308 (+ 346us) client_negotiation.cc:240] Negotiation successful
0808 23:33:40.245976 (+ 668us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":343,"threads_started":1}
I20260808 23:33:40.248847 1424 heartbeater.cc:347] Connected to a master server at 127.26.207.254:38465
I20260808 23:33:40.249277 1424 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:40.250098 1424 heartbeater.cc:511] Master 127.26.207.254:38465 requested a full tablet report, sending...
I20260808 23:33:40.251753 935 ts_manager.cc:194] Registered new tserver with Master: b91a7572764c4324893880645cf285f6 (127.26.207.195:38303)
I20260808 23:33:40.252689 935 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:54981
I20260808 23:33:40.259859 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/test-admin.keytab.
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:40.296638 27455 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 23:33:40.303184 1433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:33:40.300103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41242 (local address 127.26.207.193:34389)
0808 23:33:40.300974 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:40.300986 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:40.301023 (+ 37us) server_negotiation.cc:407] Connection header received
0808 23:33:40.301103 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:40.301112 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:40.301422 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:40.301596 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:40.302676 (+ 1080us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41242: BlockingRecv error: recv got EOF from 127.0.0.1:41242 (error 108)
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":405,"threads_started":1}
W20260808 23:33:40.303412 27455 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/krb5cc' of type FILE
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:40.305260 27455 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:40.306823 27455 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:33:40.325156 1433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:40.308738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41256 (local address 127.26.207.193:34389)
0808 23:33:40.309011 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:40.309019 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:40.309323 (+ 304us) server_negotiation.cc:407] Connection header received
0808 23:33:40.309575 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:40.309579 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:40.309646 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:40.309758 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:40.310971 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:40.312032 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:40.313447 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:40.314061 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:40.314217 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:40.318464 (+ 4247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:40.318482 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:40.318500 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:40.318546 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:40.321927 (+ 3381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:40.322803 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:40.322811 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:40.322814 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:40.322959 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:40.323411 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:40.323415 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:40.323417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:40.323814 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:40.324175 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:40.324512 (+ 337us) server_negotiation.cc:299] Negotiation successful
0808 23:33:40.324825 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
W20260808 23:33:40.331712 1433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:33:40.329719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41270 (local address 127.26.207.193:34389)
0808 23:33:40.329982 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:40.329988 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:40.330189 (+ 201us) server_negotiation.cc:407] Connection header received
0808 23:33:40.330389 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:40.330393 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:40.330464 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:40.330559 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:40.331414 (+ 855us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41270: BlockingRecv error: recv got EOF from 127.0.0.1:41270 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
W20260808 23:33:40.332329 27455 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/krb5cc)
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:40.334117 27455 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:40.335559 27455 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:33:40.351984 1433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:40.337239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41286 (local address 127.26.207.193:34389)
0808 23:33:40.337468 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:40.337476 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:40.337629 (+ 153us) server_negotiation.cc:407] Connection header received
0808 23:33:40.337772 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:40.337776 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:40.337842 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:40.337927 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:40.338854 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:40.339568 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:40.341153 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:40.341617 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:40.341722 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:40.346383 (+ 4661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:40.346397 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:40.346401 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:40.346463 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:40.349201 (+ 2738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:40.350086 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:40.350090 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:40.350093 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:40.350242 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:40.350603 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:40.350606 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:40.350608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:40.350902 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:40.351149 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:40.351414 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 23:33:40.351605 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260808 23:33:40.357025 1433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:33:40.355210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41290 (local address 127.26.207.193:34389)
0808 23:33:40.355421 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:40.355429 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:40.355559 (+ 130us) server_negotiation.cc:407] Connection header received
0808 23:33:40.355710 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:40.355714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:40.355788 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:40.355872 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:40.356705 (+ 833us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41290: BlockingRecv error: recv got EOF from 127.0.0.1:41290 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260808 23:33:40.357216 27455 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786231963826981-27455-0/krb5kdc/krb5cc' of type FILE
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:40.359040 27455 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:40.360477 27455 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:33:40.376374 1433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:40.361969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41296 (local address 127.26.207.193:34389)
0808 23:33:40.362140 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:40.362144 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:40.362612 (+ 468us) server_negotiation.cc:407] Connection header received
0808 23:33:40.362734 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:40.362739 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:40.362828 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:40.362938 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:40.363959 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:40.365168 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:40.366467 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:40.367146 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:40.367296 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:40.371134 (+ 3838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:40.371139 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:40.371142 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:40.371181 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:40.373825 (+ 2644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:40.374627 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:40.374630 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:40.374633 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:40.374796 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:40.375147 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:40.375151 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:40.375153 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:40.375450 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:40.375722 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:40.375912 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 23:33:40.376097 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 23:33:40.378192 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 1003
I20260808 23:33:40.391484 1433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:40.378944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41306 (local address 127.26.207.193:34389)
0808 23:33:40.379147 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:40.379154 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:40.379515 (+ 361us) server_negotiation.cc:407] Connection header received
0808 23:33:40.379712 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:40.379717 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:40.379792 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:40.379896 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:40.380964 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:40.381678 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:40.382920 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:40.383383 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:40.383527 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:40.385867 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:40.385872 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:40.385876 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:40.385913 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:40.388498 (+ 2585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:40.389289 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:40.389295 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:40.389298 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:40.389445 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:40.389872 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:40.389876 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:40.389878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:40.390257 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:40.390571 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:40.390867 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 23:33:40.391105 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 23:33:40.392127 1132 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:40.482939 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 1003
I20260808 23:33:40.504943 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 1145
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:33:40.522727 1447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:40.505960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55608 (local address 127.26.207.194:46005)
0808 23:33:40.506479 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:40.506488 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:40.506518 (+ 30us) server_negotiation.cc:407] Connection header received
0808 23:33:40.506584 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:40.506590 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:40.506823 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:40.506964 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:40.508069 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:40.509250 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:40.510688 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:40.511347 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:40.511454 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:40.515797 (+ 4343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:40.515815 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:40.515832 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:40.515875 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:40.519602 (+ 3727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:40.520502 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:40.520510 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:40.520513 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:40.520649 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:40.521130 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:40.521133 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:40.521135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:40.521521 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:40.521769 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:40.522096 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 23:33:40.522369 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":262,"threads_started":1}
I20260808 23:33:40.524175 1271 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:40.609892 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 1145
I20260808 23:33:40.632009 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 1283
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:33:40.650182 1449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:40.633017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52224 (local address 127.26.207.195:38303)
0808 23:33:40.633653 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:40.633660 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:40.633692 (+ 32us) server_negotiation.cc:407] Connection header received
0808 23:33:40.633757 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:40.633763 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:40.633987 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:40.634118 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:40.635267 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:40.636595 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:40.638013 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:40.638673 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:40.638796 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:40.643387 (+ 4591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:40.643411 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:40.643428 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:40.643473 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:40.646761 (+ 3288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:40.647677 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:40.647685 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:40.647688 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:40.647833 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:40.648305 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:40.648309 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:40.648312 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:40.648720 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:40.649235 (+ 515us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:40.649574 (+ 339us) server_negotiation.cc:299] Negotiation successful
0808 23:33:40.649854 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":310,"threads_started":1}
I20260808 23:33:40.651670 1418 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:40.739089 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 1283
I20260808 23:33:40.760370 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 901
I20260808 23:33:40.761958 967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:40.877395 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 901
2026-08-08T23:33:40Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4453 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[1454](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[1454](info): set up 2 sockets
Aug 08 23:33:40 dist-test-slave-1x4g krb5kdc[1454](info): commencing operation
krb5kdc: starting...
W20260808 23:33:42.049153 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.003s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:33:42 dist-test-slave-1x4g krb5kdc[1454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:33:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:33:42Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.254.keytab.
Entry for principal oryx/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.254.keytab.
I20260808 23:33:42.336660 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:40267
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.254.keytab
--principal=oryx/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:40267
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:42.703292 1467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:42.703639 1467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:42.703815 1467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:42.715458 1467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:33:42.715644 1467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:42.715726 1467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:42.715816 1467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:33:42.715884 1467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:33:42.732280 1467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:40267
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.254.keytab
--principal=oryx/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:40267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:42.733922 1467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:42.735368 1467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:42.748827 1473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:42.748764 1475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:42.749122 1472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:42.749856 1467 server_base.cc:1034] running on GCE node
I20260808 23:33:42.750820 1467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:42.752468 1467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:42.753729 1467 hybrid_clock.cc:648] HybridClock initialized: now 1786232022753678 us; error 44 us; skew 500 ppm
I20260808 23:33:42.754124 1467 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:42 dist-test-slave-1x4g krb5kdc[1454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232022, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:42.757637 1467 init.cc:377] Logged in from keytab as oryx/127.26.207.254@KRBTEST.COM (short username oryx)
I20260808 23:33:42.759356 1467 webserver.cc:460] Webserver started at http://127.26.207.254:37011/ using document root <none> and password file <none>
I20260808 23:33:42.760092 1467 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:42.760203 1467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:42.760483 1467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:42.763833 1467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "e9362a636eb74053afc1aa98c2ec8788"
format_stamp: "Formatted at 2026-08-08 23:33:42 on dist-test-slave-1x4g"
server_key: "25a352230ff1bdb639e8ac47768052f4"
server_key_iv: "16d8349465a5be4590a118da2a8217c8"
server_key_version: "encryptionkey@0"
I20260808 23:33:42.764631 1467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "e9362a636eb74053afc1aa98c2ec8788"
format_stamp: "Formatted at 2026-08-08 23:33:42 on dist-test-slave-1x4g"
server_key: "25a352230ff1bdb639e8ac47768052f4"
server_key_iv: "16d8349465a5be4590a118da2a8217c8"
server_key_version: "encryptionkey@0"
I20260808 23:33:42.770543 1467 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 23:33:42.774411 1482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:42.775934 1467 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 23:33:42.776189 1467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "e9362a636eb74053afc1aa98c2ec8788"
format_stamp: "Formatted at 2026-08-08 23:33:42 on dist-test-slave-1x4g"
server_key: "25a352230ff1bdb639e8ac47768052f4"
server_key_iv: "16d8349465a5be4590a118da2a8217c8"
server_key_version: "encryptionkey@0"
I20260808 23:33:42.776394 1467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:42.791715 1467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:42.796854 1467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:42.797139 1467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:42.817530 1467 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:40267
I20260808 23:33:42.817562 1537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:40267 every 8 connection(s)
I20260808 23:33:42.819088 1467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:33:42.823246 1538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:42.825527 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 1467
I20260808 23:33:42.825773 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:33:42.826505 27455 external_mini_cluster.cc:1428] Setting key 0f89780925db979c13c2866d5caa78de
I20260808 23:33:42.839967 1538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788: Bootstrap starting.
I20260808 23:33:42.843464 1538 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:42.844601 1538 log.cc:824] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788: Log is configured to *not* fsync() on all Append() calls
Aug 08 23:33:42 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM
I20260808 23:33:42.848714 1538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788: No bootstrap required, opened a new log
I20260808 23:33:42.856299 1541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:42.830020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53878 (local address 127.26.207.254:40267)
0808 23:33:42.832126 (+ 2106us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:42.832145 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:42.832201 (+ 56us) server_negotiation.cc:407] Connection header received
0808 23:33:42.834717 (+ 2516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:42.834745 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:42.835335 (+ 590us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:42.835835 (+ 500us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:42.837857 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:42.839301 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:42.840708 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:42.841588 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:42.841827 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:42.846427 (+ 4600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:42.846440 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:42.846462 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:42.846513 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:42.850749 (+ 4236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:42.851659 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:42.851672 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:42.851686 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:42.851957 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:42.852451 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:42.852456 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:42.852461 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:42.853387 (+ 926us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:42.853736 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:42.854163 (+ 427us) server_negotiation.cc:299] Negotiation successful
0808 23:33:42.854725 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1809,"thread_start_us":1260,"threads_started":1}
I20260808 23:33:42.859906 1538 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } }
I20260808 23:33:42.860329 1538 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:42.860420 1538 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9362a636eb74053afc1aa98c2ec8788, State: Initialized, Role: FOLLOWER
I20260808 23:33:42.861057 1538 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } }
I20260808 23:33:42.861282 1538 raft_consensus.cc:388] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:33:42.861387 1538 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:33:42.861521 1538 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:42.863826 1538 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } }
I20260808 23:33:42.864344 1538 leader_election.cc:302] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9362a636eb74053afc1aa98c2ec8788; no voters:
I20260808 23:33:42.865072 1538 leader_election.cc:288] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:33:42.865869 1544 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:42.866580 1544 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [term 1 LEADER]: Becoming Leader. State: Replica: e9362a636eb74053afc1aa98c2ec8788, State: Running, Role: LEADER
I20260808 23:33:42.867199 1544 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } }
I20260808 23:33:42.867501 1538 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:33:42.870404 1546 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9362a636eb74053afc1aa98c2ec8788. Latest consensus state: current_term: 1 leader_uuid: "e9362a636eb74053afc1aa98c2ec8788" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } }
I20260808 23:33:42.871102 1546 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:42.871135 1545 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9362a636eb74053afc1aa98c2ec8788" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } }
I20260808 23:33:42.871496 1545 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:42.873405 1553 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:33:42.879560 1553 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:33:42.889909 1553 catalog_manager.cc:1347] Generated new cluster ID: 734291609f0d48a19740bd2b3f1e023f
I20260808 23:33:42.890061 1553 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:33:42.935402 1553 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:33:42.936978 1553 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:33:42.946301 1553 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788: Generated new TSK 0
I20260808 23:33:42.947304 1553 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.193.keytab.
Entry for principal oryx/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.193.keytab.
I20260808 23:33:43.025264 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:40267
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.193.keytab
--principal=oryx/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:43.398707 1567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:43.399091 1567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:43.399251 1567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:43.406874 1567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:43.407058 1567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:43.407233 1567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:33:43.417564 1567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.193.keytab
--principal=oryx/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:40267
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:43.419064 1567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:43.420499 1567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:43.434860 1574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:43.434952 1573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:43.435163 1576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:43.435995 1567 server_base.cc:1034] running on GCE node
I20260808 23:33:43.436745 1567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:43.437875 1567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:43.439091 1567 hybrid_clock.cc:648] HybridClock initialized: now 1786232023439039 us; error 37 us; skew 500 ppm
I20260808 23:33:43.439424 1567 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:43 dist-test-slave-1x4g krb5kdc[1454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232023, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:43.442997 1567 init.cc:377] Logged in from keytab as oryx/127.26.207.193@KRBTEST.COM (short username oryx)
I20260808 23:33:43.444595 1567 webserver.cc:460] Webserver started at http://127.26.207.193:38379/ using document root <none> and password file <none>
I20260808 23:33:43.445533 1567 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:43.445683 1567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:43.446033 1567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:43.449513 1567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2"
format_stamp: "Formatted at 2026-08-08 23:33:43 on dist-test-slave-1x4g"
server_key: "502ff9d3950c7cd1f0b59bba75a131e6"
server_key_iv: "77399091cee9234ac7993b4ec8b37721"
server_key_version: "encryptionkey@0"
I20260808 23:33:43.450434 1567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2"
format_stamp: "Formatted at 2026-08-08 23:33:43 on dist-test-slave-1x4g"
server_key: "502ff9d3950c7cd1f0b59bba75a131e6"
server_key_iv: "77399091cee9234ac7993b4ec8b37721"
server_key_version: "encryptionkey@0"
I20260808 23:33:43.456174 1567 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 23:33:43.460566 1583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:43.462131 1567 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:33:43.462345 1567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2"
format_stamp: "Formatted at 2026-08-08 23:33:43 on dist-test-slave-1x4g"
server_key: "502ff9d3950c7cd1f0b59bba75a131e6"
server_key_iv: "77399091cee9234ac7993b4ec8b37721"
server_key_version: "encryptionkey@0"
I20260808 23:33:43.462586 1567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:43.478327 1567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:43.483237 1567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:43.483577 1567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:43.484627 1567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:43.486281 1567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:43.486394 1567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:43.486567 1567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:43.486650 1567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:43.523399 1567 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:44589
I20260808 23:33:43.523495 1699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:44589 every 8 connection(s)
I20260808 23:33:43.524919 1567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:33:43.529019 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 1567
I20260808 23:33:43.529284 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:33:43.530298 27455 external_mini_cluster.cc:1428] Setting key 7a05d3f9bf2656fbda9fb1905f8b1bcc
Aug 08 23:33:43 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232023, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM
I20260808 23:33:43.552711 1703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:43.527733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:47865 (local address 127.26.207.254:40267)
0808 23:33:43.528235 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:43.528243 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:43.529672 (+ 1429us) server_negotiation.cc:407] Connection header received
0808 23:33:43.532392 (+ 2720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:43.532399 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:43.532484 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:43.532620 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:43.535200 (+ 2580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:43.535919 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:43.538742 (+ 2823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:43.539141 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:43.539247 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:43.544491 (+ 5244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:43.544501 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:43.544508 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:43.544570 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:43.548439 (+ 3869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:43.549739 (+ 1300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:43.549747 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:43.549753 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:43.549929 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:43.550458 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:43.550466 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:43.550473 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:43.550892 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:43.551057 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:43.551942 (+ 885us) server_negotiation.cc:299] Negotiation successful
0808 23:33:43.552223 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":231,"threads_started":1}
I20260808 23:33:43.553507 1704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:43.528390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.193:47865)
0808 23:33:43.529430 (+ 1040us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:43.529494 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:43.532018 (+ 2524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:43.533045 (+ 1027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:43.533060 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:43.533977 (+ 917us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:43.534945 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:43.534982 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:43.536128 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:43.536136 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:43.538536 (+ 2400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:43.538561 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:43.539422 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:43.539434 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:43.539817 (+ 383us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:43.540694 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:43.540736 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:43.544152 (+ 3416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:43.548671 (+ 4519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:43.548680 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:43.548696 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:43.549565 (+ 869us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:43.550076 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:43.550080 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:43.550083 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:43.550315 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:43.551057 (+ 742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:43.551066 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:43.551490 (+ 424us) client_negotiation.cc:769] Sending connection context
0808 23:33:43.551761 (+ 271us) client_negotiation.cc:240] Negotiation successful
0808 23:33:43.552214 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":398,"threads_started":1}
I20260808 23:33:43.555449 1700 heartbeater.cc:347] Connected to a master server at 127.26.207.254:40267
I20260808 23:33:43.555845 1700 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:43.556988 1700 heartbeater.cc:511] Master 127.26.207.254:40267 requested a full tablet report, sending...
I20260808 23:33:43.559604 1501 ts_manager.cc:194] Registered new tserver with Master: 3dcaa86a10ba432e9ef9cfea12acc2d2 (127.26.207.193:44589)
WARNING: no policy specified for oryx/127.26.207.194@KRBTEST.COM; defaulting to no policy
I20260808 23:33:43.561306 1501 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:47865
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.207.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.194.keytab.
Entry for principal oryx/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.194.keytab.
I20260808 23:33:43.596324 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:40267
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.194.keytab
--principal=oryx/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:43.950929 1707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:43.951228 1707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:43.951385 1707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:43.958869 1707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:43.958997 1707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:43.959225 1707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:33:43.969764 1707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.194.keytab
--principal=oryx/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:40267
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:43.971146 1707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:43.972527 1707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:43.986624 1712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:43.986737 1717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:43.986701 1713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:43.987568 1707 server_base.cc:1034] running on GCE node
I20260808 23:33:43.988301 1707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:43.989449 1707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:43.990712 1707 hybrid_clock.cc:648] HybridClock initialized: now 1786232023990675 us; error 36 us; skew 500 ppm
I20260808 23:33:43.991096 1707 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:43 dist-test-slave-1x4g krb5kdc[1454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232023, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:43.994679 1707 init.cc:377] Logged in from keytab as oryx/127.26.207.194@KRBTEST.COM (short username oryx)
I20260808 23:33:43.996369 1707 webserver.cc:460] Webserver started at http://127.26.207.194:44551/ using document root <none> and password file <none>
I20260808 23:33:43.997252 1707 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:43.997406 1707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:43.997740 1707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:44.001116 1707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "a7837de2d37f47c3b0f92d89fe52b99a"
format_stamp: "Formatted at 2026-08-08 23:33:43 on dist-test-slave-1x4g"
server_key: "9f1e496e1fe687cff3473e155ca5ead0"
server_key_iv: "9d1fd3c6b6df7149fc2ccd49a82c001b"
server_key_version: "encryptionkey@0"
I20260808 23:33:44.001982 1707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "a7837de2d37f47c3b0f92d89fe52b99a"
format_stamp: "Formatted at 2026-08-08 23:33:43 on dist-test-slave-1x4g"
server_key: "9f1e496e1fe687cff3473e155ca5ead0"
server_key_iv: "9d1fd3c6b6df7149fc2ccd49a82c001b"
server_key_version: "encryptionkey@0"
I20260808 23:33:44.007735 1707 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260808 23:33:44.011570 1724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:44.013195 1707 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 23:33:44.013396 1707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "a7837de2d37f47c3b0f92d89fe52b99a"
format_stamp: "Formatted at 2026-08-08 23:33:43 on dist-test-slave-1x4g"
server_key: "9f1e496e1fe687cff3473e155ca5ead0"
server_key_iv: "9d1fd3c6b6df7149fc2ccd49a82c001b"
server_key_version: "encryptionkey@0"
I20260808 23:33:44.013623 1707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:44.038393 1707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:44.043198 1707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:44.043531 1707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:44.044595 1707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:44.046121 1707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:44.046229 1707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:44.046391 1707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:44.046465 1707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:44.082835 1707 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:36475
I20260808 23:33:44.082932 1843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:36475 every 8 connection(s)
I20260808 23:33:44.084244 1707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:33:44.094491 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 1707
I20260808 23:33:44.094702 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:33:44.095333 27455 external_mini_cluster.cc:1428] Setting key b534634435ccade5d96d143f768fc0fa
Aug 08 23:33:44 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232023, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM
I20260808 23:33:44.106559 1846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:44.087041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:36299 (local address 127.26.207.254:40267)
0808 23:33:44.087555 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:44.087563 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:44.088558 (+ 995us) server_negotiation.cc:407] Connection header received
0808 23:33:44.090530 (+ 1972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:44.090535 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:44.090628 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:44.090733 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:44.092393 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:44.093255 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:44.094969 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:44.095657 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:44.095801 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:44.100038 (+ 4237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:44.100044 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:44.100047 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:44.100083 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:44.102883 (+ 2800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:44.103973 (+ 1090us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:44.103977 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:44.103980 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:44.104116 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:44.104634 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:44.104637 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:44.104639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:44.104974 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:44.105092 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:44.106076 (+ 984us) server_negotiation.cc:299] Negotiation successful
0808 23:33:44.106260 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":238,"threads_started":1}
I20260808 23:33:44.108201 1847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:44.087630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.194:36299)
0808 23:33:44.088374 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:44.088421 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:44.090227 (+ 1806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:44.090975 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:44.090984 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:44.091570 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:44.092199 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:44.092218 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:44.093409 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:44.093413 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:44.094810 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:44.094829 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:44.095882 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:44.095887 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:44.096101 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:44.096894 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:44.096918 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:44.099788 (+ 2870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:44.103069 (+ 3281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:44.103089 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:44.103112 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:44.103837 (+ 725us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:44.104231 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:44.104239 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:44.104245 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:44.104516 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:44.105121 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:44.105133 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:44.105657 (+ 524us) client_negotiation.cc:769] Sending connection context
0808 23:33:44.106011 (+ 354us) client_negotiation.cc:240] Negotiation successful
0808 23:33:44.106657 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":286,"threads_started":1}
I20260808 23:33:44.109900 1844 heartbeater.cc:347] Connected to a master server at 127.26.207.254:40267
I20260808 23:33:44.110261 1844 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:44.111055 1844 heartbeater.cc:511] Master 127.26.207.254:40267 requested a full tablet report, sending...
I20260808 23:33:44.112747 1501 ts_manager.cc:194] Registered new tserver with Master: a7837de2d37f47c3b0f92d89fe52b99a (127.26.207.194:36475)
I20260808 23:33:44.113686 1501 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:36299
WARNING: no policy specified for oryx/127.26.207.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.195.keytab.
Entry for principal oryx/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.195.keytab.
I20260808 23:33:44.157073 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:40267
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.195.keytab
--principal=oryx/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:44.526688 1850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:44.527084 1850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:44.527318 1850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:44.535571 1850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:44.535698 1850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:44.535889 1850 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:33:44.546254 1850 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.195.keytab
--principal=oryx/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:40267
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:44.547676 1850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:44.549131 1850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:44.563180 1859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:44.563220 1855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:44.563251 1856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:44.563886 1850 server_base.cc:1034] running on GCE node
I20260808 23:33:44.564630 1850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:44.564939 1700 heartbeater.cc:503] Master 127.26.207.254:40267 was elected leader, sending a full tablet report...
I20260808 23:33:44.565977 1850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:44.567198 1850 hybrid_clock.cc:648] HybridClock initialized: now 1786232024567143 us; error 52 us; skew 500 ppm
I20260808 23:33:44.567587 1850 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:44 dist-test-slave-1x4g krb5kdc[1454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232024, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:44.570963 1850 init.cc:377] Logged in from keytab as oryx/127.26.207.195@KRBTEST.COM (short username oryx)
I20260808 23:33:44.572567 1850 webserver.cc:460] Webserver started at http://127.26.207.195:38701/ using document root <none> and password file <none>
I20260808 23:33:44.573398 1850 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:44.573554 1850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:44.573889 1850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:44.577044 1850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "6a46660e47fd4c6c8561cee666054b1e"
format_stamp: "Formatted at 2026-08-08 23:33:44 on dist-test-slave-1x4g"
server_key: "22ac68f0125bf9aea98410d2cbccd281"
server_key_iv: "cee996c68b48a775d9440e029061b6a4"
server_key_version: "encryptionkey@0"
I20260808 23:33:44.577886 1850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "6a46660e47fd4c6c8561cee666054b1e"
format_stamp: "Formatted at 2026-08-08 23:33:44 on dist-test-slave-1x4g"
server_key: "22ac68f0125bf9aea98410d2cbccd281"
server_key_iv: "cee996c68b48a775d9440e029061b6a4"
server_key_version: "encryptionkey@0"
I20260808 23:33:44.583647 1850 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260808 23:33:44.587488 1867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:44.589116 1850 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 23:33:44.589308 1850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "6a46660e47fd4c6c8561cee666054b1e"
format_stamp: "Formatted at 2026-08-08 23:33:44 on dist-test-slave-1x4g"
server_key: "22ac68f0125bf9aea98410d2cbccd281"
server_key_iv: "cee996c68b48a775d9440e029061b6a4"
server_key_version: "encryptionkey@0"
I20260808 23:33:44.589546 1850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:44.606668 1850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:44.611493 1850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:44.611843 1850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:44.612939 1850 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:44.614405 1850 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:44.614512 1850 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:44.614674 1850 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:44.614749 1850 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:44.650388 1850 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:39753
I20260808 23:33:44.650435 1982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:39753 every 8 connection(s)
I20260808 23:33:44.651813 1850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:33:44.655779 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 1850
I20260808 23:33:44.656002 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:33:44.656584 27455 external_mini_cluster.cc:1428] Setting key 088642da3871d38483ae3af8e1e6f8ab
Aug 08 23:33:44 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232024, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM
I20260808 23:33:44.674465 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:44.654610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:50339 (local address 127.26.207.254:40267)
0808 23:33:44.655050 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:44.655055 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:44.656296 (+ 1241us) server_negotiation.cc:407] Connection header received
0808 23:33:44.658307 (+ 2011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:44.658313 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:44.658424 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:44.658547 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:44.660108 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:44.660967 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:44.662577 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:44.662996 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:44.663139 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:44.667553 (+ 4414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:44.667559 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:44.667564 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:44.667607 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:44.670717 (+ 3110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:44.671622 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:44.671632 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:44.671638 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:44.671795 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:44.672305 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:44.672311 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:44.672317 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:44.672677 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:44.672925 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:44.673720 (+ 795us) server_negotiation.cc:299] Negotiation successful
0808 23:33:44.674012 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":206,"threads_started":1}
I20260808 23:33:44.675647 1986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:44.655193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.195:50339)
0808 23:33:44.656128 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:44.656179 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:44.658029 (+ 1850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:44.658810 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:44.658819 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:44.659340 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:44.659930 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:44.659948 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:44.661142 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:44.661147 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:44.662415 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:44.662428 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:44.663249 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:44.663256 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:44.663522 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:44.664268 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:44.664306 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:44.667237 (+ 2931us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:44.670915 (+ 3678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:44.670927 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:44.670947 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:44.671478 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:44.671932 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:44.671939 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:44.671943 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:44.672172 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:44.672855 (+ 683us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:44.672864 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:44.673282 (+ 418us) client_negotiation.cc:769] Sending connection context
0808 23:33:44.673632 (+ 350us) client_negotiation.cc:240] Negotiation successful
0808 23:33:44.674259 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":345,"threads_started":1}
I20260808 23:33:44.677419 1983 heartbeater.cc:347] Connected to a master server at 127.26.207.254:40267
I20260808 23:33:44.677734 1983 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:44.678535 1983 heartbeater.cc:511] Master 127.26.207.254:40267 requested a full tablet report, sending...
I20260808 23:33:44.680135 1501 ts_manager.cc:194] Registered new tserver with Master: 6a46660e47fd4c6c8561cee666054b1e (127.26.207.195:39753)
I20260808 23:33:44.681090 1501 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:50339
I20260808 23:33:44.685046 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.207.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.207.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.207.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.253.keytab.
Entry for principal oryx/127.26.207.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.253.keytab.
I20260808 23:33:44.749223 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.253:46827
--webserver_interface=127.26.207.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.253.keytab
--principal=oryx/127.26.207.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:40267,127.26.207.253:46827
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:33:45.116464 1844 heartbeater.cc:503] Master 127.26.207.254:40267 was elected leader, sending a full tablet report...
W20260808 23:33:45.150808 1989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:45.151199 1989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:45.151365 1989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:45.159449 1989 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:33:45.159623 1989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:45.159723 1989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:45.159825 1989 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:33:45.159902 1989 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:33:45.172475 1989 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:40267,127.26.207.253:46827
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.253.keytab
--principal=oryx/127.26.207.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.253:46827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.207.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
W20260808 23:33:45.173026 1989 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.26.207.254:40267,127.26.207.253:46827'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 23:33:45.174309 1989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:45.175724 1989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:45.190105 1999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:45.190336 1996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:45.190104 1997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:45.191171 1989 server_base.cc:1034] running on GCE node
I20260808 23:33:45.192058 1989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:45.193979 1989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:45.195276 1989 hybrid_clock.cc:648] HybridClock initialized: now 1786232025195161 us; error 69 us; skew 500 ppm
I20260808 23:33:45.195695 1989 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:45 dist-test-slave-1x4g krb5kdc[1454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232025, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:45.200562 1989 init.cc:377] Logged in from keytab as oryx/127.26.207.253@KRBTEST.COM (short username oryx)
I20260808 23:33:45.202875 1989 webserver.cc:460] Webserver started at http://127.26.207.253:46411/ using document root <none> and password file <none>
I20260808 23:33:45.203864 1989 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:45.204071 1989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:45.204540 1989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:45.208983 1989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/data/instance:
uuid: "fed0120785684cec9aa6afa46f6058b7"
format_stamp: "Formatted at 2026-08-08 23:33:45 on dist-test-slave-1x4g"
server_key: "930d59146688418ab0b3f1861d4cc694"
server_key_iv: "35415b750ca80f2d1c0121e7525f7482"
server_key_version: "encryptionkey@0"
I20260808 23:33:45.210081 1989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/wal/instance:
uuid: "fed0120785684cec9aa6afa46f6058b7"
format_stamp: "Formatted at 2026-08-08 23:33:45 on dist-test-slave-1x4g"
server_key: "930d59146688418ab0b3f1861d4cc694"
server_key_iv: "35415b750ca80f2d1c0121e7525f7482"
server_key_version: "encryptionkey@0"
I20260808 23:33:45.217628 1989 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260808 23:33:45.223628 2006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:45.226218 1989 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260808 23:33:45.226437 1989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/wal
uuid: "fed0120785684cec9aa6afa46f6058b7"
format_stamp: "Formatted at 2026-08-08 23:33:45 on dist-test-slave-1x4g"
server_key: "930d59146688418ab0b3f1861d4cc694"
server_key_iv: "35415b750ca80f2d1c0121e7525f7482"
server_key_version: "encryptionkey@0"
I20260808 23:33:45.226761 1989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:45.286681 1989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:45.292079 1989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:45.292340 1989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:45.319603 1989 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.253:46827
I20260808 23:33:45.319702 2060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.253:46827 every 8 connection(s)
I20260808 23:33:45.321187 1989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/data/info.pb
I20260808 23:33:45.325590 2061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:45.330428 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 1989
I20260808 23:33:45.333927 2061 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:33:45 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232025, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.253@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM
Aug 08 23:33:45 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.207.253@KRBTEST.COM
I20260808 23:33:45.356472 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:45.339126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53894 (local address 127.26.207.254:40267)
0808 23:33:45.339786 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:45.339795 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:45.340521 (+ 726us) server_negotiation.cc:407] Connection header received
0808 23:33:45.340714 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:45.340720 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:45.340836 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:45.340962 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:45.342146 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.343024 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.344615 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.345120 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.345228 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:45.349024 (+ 3796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:45.349032 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:45.349038 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:45.349103 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:45.352221 (+ 3118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:45.353344 (+ 1123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:45.353348 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:45.353350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:45.353505 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:45.354037 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:45.354042 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:45.354045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:45.354541 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:45.354688 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:45.355696 (+ 1008us) server_negotiation.cc:299] Negotiation successful
0808 23:33:45.355968 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":353,"threads_started":1}
I20260808 23:33:45.358006 2064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:45.332874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58078 (local address 127.26.207.253:46827)
0808 23:33:45.333799 (+ 925us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:45.333811 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:45.333854 (+ 43us) server_negotiation.cc:407] Connection header received
0808 23:33:45.336534 (+ 2680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:45.336562 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:45.337087 (+ 525us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:45.337428 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:45.339573 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.341536 (+ 1963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.342871 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.343651 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.343876 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:45.349804 (+ 5928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:45.349813 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:45.349827 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:45.349887 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:45.353668 (+ 3781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:45.354648 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:45.354658 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:45.354661 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:45.354818 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:45.355233 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:45.355238 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:45.355241 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:45.355720 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:45.356060 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:45.356445 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 23:33:45.356705 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":392,"threads_started":1}
I20260808 23:33:45.358032 2066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:45.339148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:53894)
0808 23:33:45.340349 (+ 1201us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:45.340405 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:45.340577 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:45.341020 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:45.341026 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:45.341714 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:45.341973 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:45.341983 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.343183 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.343191 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:45.344439 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:45.344460 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.345364 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.345369 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:45.345512 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:45.346137 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:45.346161 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:45.348714 (+ 2553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:45.352392 (+ 3678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:45.352407 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:45.352440 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:45.353176 (+ 736us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:45.353632 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:45.353637 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:45.353640 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:45.353893 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:45.354664 (+ 771us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:45.354672 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:45.355145 (+ 473us) client_negotiation.cc:769] Sending connection context
0808 23:33:45.355613 (+ 468us) client_negotiation.cc:240] Negotiation successful
0808 23:33:45.356200 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":908,"spinlock_wait_cycles":23936,"thread_start_us":661,"threads_started":1}
I20260808 23:33:45.360394 2061 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:33:45 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232025, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.253@KRBTEST.COM for oryx/127.26.207.253@KRBTEST.COM
I20260808 23:33:45.375406 2066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:45.361359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:46827 (local address 127.0.0.1:58088)
0808 23:33:45.361839 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:45.361855 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:45.361995 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:45.362292 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:45.362296 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:45.362681 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:45.362815 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:45.362823 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.363912 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.363968 (+ 56us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:45.365097 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:45.365112 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.365985 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.365991 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:45.366195 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:45.366927 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:45.366945 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:45.369496 (+ 2551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:45.373165 (+ 3669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:45.373169 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:45.373172 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:45.373679 (+ 507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:45.374025 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:45.374028 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:45.374030 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:45.374169 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:45.374662 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:45.374665 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:45.374789 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 23:33:45.374902 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 23:33:45.375153 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393}
I20260808 23:33:45.375634 2064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:45.361392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58088 (local address 127.26.207.253:46827)
0808 23:33:45.361569 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:45.361575 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:45.361927 (+ 352us) server_negotiation.cc:407] Connection header received
0808 23:33:45.362115 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:45.362124 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:45.362177 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:45.362273 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:45.362961 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.363763 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.365257 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.365797 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.365961 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:45.369749 (+ 3788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:45.369754 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:45.369758 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:45.369791 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:45.373001 (+ 3210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:45.373803 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:45.373807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:45.373810 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:45.373929 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:45.374261 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:45.374264 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:45.374266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:45.374564 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:45.374675 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:45.374988 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 23:33:45.375285 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":107,"server-negotiator.queue_time_us":64}
I20260808 23:33:45.380761 2061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: Bootstrap starting.
I20260808 23:33:45.384902 2061 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:45.386242 2061 log.cc:824] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:45.389335 2061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: No bootstrap required, opened a new log
I20260808 23:33:45.397280 2061 raft_consensus.cc:348] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } }
I20260808 23:33:45.397672 2061 raft_consensus.cc:374] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:45.397799 2061 raft_consensus.cc:729] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fed0120785684cec9aa6afa46f6058b7, State: Initialized, Role: FOLLOWER
I20260808 23:33:45.398460 2061 consensus_queue.cc:260] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } }
I20260808 23:33:45.399461 2068 sys_catalog.cc:455] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } } }
I20260808 23:33:45.399820 2068 sys_catalog.cc:458] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:33:45.400642 2061 sys_catalog.cc:564] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 23:33:45.412400 2079 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 23:33:45.412611 2079 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 23:33:45.416587 1989 master_runner.cc:428] Detected that this master fed0120785684cec9aa6afa46f6058b7 is joining an existing cluster
I20260808 23:33:45.416735 1989 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.207.253:46827
I20260808 23:33:45.448583 2085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:45.424812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:46827 (local address 127.0.0.1:58102)
0808 23:33:45.425980 (+ 1168us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:45.426006 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:45.426239 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:45.426790 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:45.426796 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:45.427567 (+ 771us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:45.428077 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:45.428092 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.430529 (+ 2437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.430536 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:45.432544 (+ 2008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:45.432559 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.434137 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.434144 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:45.434338 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:45.435150 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:45.435178 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:45.436572 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:45.443816 (+ 7244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:45.443821 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:45.443826 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:45.444691 (+ 865us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:45.445370 (+ 679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:45.445374 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:45.445377 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:45.445638 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:45.446629 (+ 991us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:45.446637 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:45.446838 (+ 201us) client_negotiation.cc:769] Sending connection context
0808 23:33:45.447017 (+ 179us) client_negotiation.cc:240] Negotiation successful
0808 23:33:45.447553 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":994,"thread_start_us":832,"threads_started":1}
WARNING: no policy specified for oryx/127.26.207.252@KRBTEST.COM; defaulting to no policy
I20260808 23:33:45.449879 2064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:45.424487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58102 (local address 127.26.207.253:46827)
0808 23:33:45.425319 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:45.425328 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:45.426098 (+ 770us) server_negotiation.cc:407] Connection header received
0808 23:33:45.426400 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:45.426405 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:45.426479 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:45.426557 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:45.428868 (+ 2311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.430200 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.432745 (+ 2545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.433682 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.433817 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:45.436830 (+ 3013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:45.436837 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:45.436842 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:45.436881 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:45.443612 (+ 6731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:45.444862 (+ 1250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:45.444868 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:45.444895 (+ 27us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:45.445177 (+ 282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:45.445820 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:45.445828 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:45.445834 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:45.446388 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:45.448363 (+ 1975us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:45.448976 (+ 613us) server_negotiation.cc:299] Negotiation successful
0808 23:33:45.449286 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":629}
I20260808 23:33:45.450624 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:45.424820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53902 (local address 127.26.207.254:40267)
0808 23:33:45.425052 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:45.425062 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:45.428597 (+ 3535us) server_negotiation.cc:407] Connection header received
0808 23:33:45.428833 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:45.428841 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:45.428964 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:45.429080 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:45.430893 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.432161 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.435196 (+ 3035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.435963 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.436076 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:45.440113 (+ 4037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:45.440119 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:45.440123 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:45.440161 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:45.445398 (+ 5237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:45.446538 (+ 1140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:45.446547 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:45.446552 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:45.446843 (+ 291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:45.447451 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:45.447471 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:45.447475 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:45.447990 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:45.448160 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:45.449912 (+ 1752us) server_negotiation.cc:299] Negotiation successful
0808 23:33:45.450208 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 23:33:45.451340 2087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:45.426375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:53902)
0808 23:33:45.428463 (+ 2088us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:45.428482 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:45.428647 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:45.429277 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:45.429282 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:45.430044 (+ 762us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:45.430664 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:45.430679 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.432423 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.432429 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:45.434945 (+ 2516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:45.434970 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.436505 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.436513 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:45.436865 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:45.437945 (+ 1080us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:45.437973 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:45.439845 (+ 1872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:45.445617 (+ 5772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:45.445623 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:45.445626 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:45.446339 (+ 713us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:45.447017 (+ 678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:45.447022 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:45.447027 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:45.447279 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:45.448274 (+ 995us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:45.448291 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:45.449487 (+ 1196us) client_negotiation.cc:769] Sending connection context
0808 23:33:45.449686 (+ 199us) client_negotiation.cc:240] Negotiation successful
0808 23:33:45.450381 (+ 695us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1941,"mutex_wait_us":28,"spinlock_wait_cycles":1408,"thread_start_us":1688,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.207.252@KRBTEST.COM" created.
Aug 08 23:33:45 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232022, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.254@KRBTEST.COM for oryx/127.26.207.253@KRBTEST.COM
I20260808 23:33:45.482736 2064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:45.459671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58104 (local address 127.26.207.253:46827)
0808 23:33:45.459894 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:45.459903 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:45.460998 (+ 1095us) server_negotiation.cc:407] Connection header received
0808 23:33:45.461335 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:45.461342 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:45.461470 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:45.461621 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:45.463866 (+ 2245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.465139 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.467747 (+ 2608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.468915 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.469102 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:45.474215 (+ 5113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:45.474225 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:45.474232 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:45.474285 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:45.478479 (+ 4194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:45.479767 (+ 1288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:45.479773 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:45.479777 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:45.479976 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:45.480648 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:45.480654 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:45.480658 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:45.481112 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:45.481268 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:45.482052 (+ 784us) server_negotiation.cc:299] Negotiation successful
0808 23:33:45.482340 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 23:33:45.483016 2089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:45.459629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:46827 (local address 127.0.0.1:58104)
0808 23:33:45.460739 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:45.460866 (+ 127us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:45.461093 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:45.461714 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:45.461727 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:45.463084 (+ 1357us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:45.463630 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:45.463651 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.465337 (+ 1686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.465347 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:45.467508 (+ 2161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:45.467534 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.469138 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.469148 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:45.469410 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:45.470325 (+ 915us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:45.470359 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:45.473945 (+ 3586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:45.478721 (+ 4776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:45.478744 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:45.478756 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:45.479603 (+ 847us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:45.480140 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:45.480149 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:45.480156 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:45.480510 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:45.481290 (+ 780us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:45.481301 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:45.481650 (+ 349us) client_negotiation.cc:769] Sending connection context
0808 23:33:45.481929 (+ 279us) client_negotiation.cc:240] Negotiation successful
0808 23:33:45.482383 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":767,"thread_start_us":409,"threads_started":1}
I20260808 23:33:45.486496 1501 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.207.253:46827: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "fed0120785684cec9aa6afa46f6058b7"
member_type: NON_VOTER
last_known_addr {
host: "127.26.207.253"
port: 46827
}
attrs {
promote: true
}
}
dest_uuid: "e9362a636eb74053afc1aa98c2ec8788"
cas_config_opid_index: -1
I20260808 23:33:45.488741 1501 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: NON_VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: true } }
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.207.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.252.keytab.
Entry for principal oryx/127.26.207.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.252.keytab.
I20260808 23:33:45.502876 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.252:36471
--webserver_interface=127.26.207.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.252.keytab
--principal=oryx/127.26.207.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:40267,127.26.207.253:46827,127.26.207.252:36471
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:33:45.502139 2092 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER fed0120785684cec9aa6afa46f6058b7 (127.26.207.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: NON_VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: true } } }
I20260808 23:33:45.505676 2035 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:45.509999 2035 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 1 FOLLOWER]: Refusing update from remote peer e9362a636eb74053afc1aa98c2ec8788: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 23:33:45.509495 2092 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.207.253:46827
I20260808 23:33:45.511816 2093 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e9362a636eb74053afc1aa98c2ec8788" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: NON_VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: true } } }
I20260808 23:33:45.512451 2093 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:45.513547 2092 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: NON_VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:45.523840 1989 master.cc:537] Master@127.26.207.253:46827 shutting down...
W20260808 23:33:45.531963 1483 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 23:33:45.545305 2012 tablet.cc:2369] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:33:45.554049 1989 raft_consensus.cc:2229] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:45.554576 1989 raft_consensus.cc:2258] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:45.554893 1989 tablet_replica.cc:330] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: stopping tablet replica
W20260808 23:33:45.558279 1483 consensus_peers.cc:487] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 -> Peer fed0120785684cec9aa6afa46f6058b7 (127.26.207.253:46827): Couldn't send request to peer fed0120785684cec9aa6afa46f6058b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 23:33:45.562495 1989 master.cc:552] Master@127.26.207.253:46827 shutdown complete.
I20260808 23:33:45.562650 1989 master_runner.cc:305] Clearing existing system tablet
I20260808 23:33:45.563129 1989 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:45.563241 1989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:45.565845 1989 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.001s
I20260808 23:33:45.573350 2101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:45.573844 1989 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:45.574196 1989 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.004s sys 0.004s
I20260808 23:33:45.574303 1989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/wal
uuid: "fed0120785684cec9aa6afa46f6058b7"
format_stamp: "Formatted at 2026-08-08 23:33:45 on dist-test-slave-1x4g"
server_key: "930d59146688418ab0b3f1861d4cc694"
server_key_iv: "35415b750ca80f2d1c0121e7525f7482"
server_key_version: "encryptionkey@0"
I20260808 23:33:45.578310 1989 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:45.584012 1989 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 23:33:45.584229 1989 log.cc:1196] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 23:33:45.584673 1989 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: Deleting consensus metadata
I20260808 23:33:45.584991 1989 master_runner.cc:315] Copying system tablet from 127.26.207.254:40267
I20260808 23:33:45.590870 1989 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: tablet copy: Beginning tablet copy session from remote peer at address 127.26.207.254:40267
I20260808 23:33:45.606771 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:45.592478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53904 (local address 127.26.207.254:40267)
0808 23:33:45.592821 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:45.592827 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:45.592850 (+ 23us) server_negotiation.cc:407] Connection header received
0808 23:33:45.593124 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:45.593132 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:45.593261 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:45.593340 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:45.594726 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.595476 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.596803 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.597420 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.597570 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:45.599748 (+ 2178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:45.599759 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:45.599762 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:45.599796 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:45.603477 (+ 3681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:45.604325 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:45.604332 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:45.604336 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:45.604562 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:45.605059 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:45.605064 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:45.605067 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:45.605433 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:45.605621 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:45.606026 (+ 405us) server_negotiation.cc:299] Negotiation successful
0808 23:33:45.606254 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180}
I20260808 23:33:45.606817 2107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:45.591931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:53904)
0808 23:33:45.592625 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:45.592648 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:45.592917 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:45.593597 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:45.593602 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:45.594275 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:45.594563 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:45.594574 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.595626 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.595632 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:45.596590 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:45.596619 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.597581 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.597586 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:45.597853 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:45.598561 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:45.598585 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:45.599500 (+ 915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:45.603623 (+ 4123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:45.603630 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:45.603634 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:45.604194 (+ 560us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:45.604683 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:45.604688 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:45.604693 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:45.604941 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:45.605582 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:45.605587 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:45.605768 (+ 181us) client_negotiation.cc:769] Sending connection context
0808 23:33:45.605919 (+ 151us) client_negotiation.cc:240] Negotiation successful
0808 23:33:45.606268 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":929,"threads_started":1}
I20260808 23:33:45.608114 1522 tablet_copy_service.cc:140] P e9362a636eb74053afc1aa98c2ec8788: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer fed0120785684cec9aa6afa46f6058b7 ({username='oryx', principal='oryx/127.26.207.253@KRBTEST.COM'} at 127.0.0.1:53904)
I20260808 23:33:45.608588 1522 tablet_copy_service.cc:161] P e9362a636eb74053afc1aa98c2ec8788: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer fed0120785684cec9aa6afa46f6058b7 at {username='oryx', principal='oryx/127.26.207.253@KRBTEST.COM'} at 127.0.0.1:53904: session id = fed0120785684cec9aa6afa46f6058b7-00000000000000000000000000000000
I20260808 23:33:45.612298 1522 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 23:33:45.614898 1989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 23:33:45.621104 1989 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: tablet copy: Starting download of 0 data blocks...
I20260808 23:33:45.621557 1989 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: tablet copy: Starting download of 1 WAL segments...
I20260808 23:33:45.625466 1989 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 23:33:45.629871 1522 tablet_copy_service.cc:342] P e9362a636eb74053afc1aa98c2ec8788: Request end of tablet copy session fed0120785684cec9aa6afa46f6058b7-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.207.253@KRBTEST.COM'} at 127.0.0.1:53904
I20260808 23:33:45.630178 1522 tablet_copy_service.cc:433] P e9362a636eb74053afc1aa98c2ec8788: ending tablet copy session fed0120785684cec9aa6afa46f6058b7-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer fed0120785684cec9aa6afa46f6058b7
I20260808 23:33:45.642246 1989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:45.645570 2108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:45.646044 2109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:45.654248 1989 server_base.cc:1034] running on GCE node
W20260808 23:33:45.654636 2112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:45.655061 1989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:45.655738 1989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:45.657047 1989 hybrid_clock.cc:648] HybridClock initialized: now 1786232025656978 us; error 31 us; skew 500 ppm
I20260808 23:33:45.657302 1989 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:45 dist-test-slave-1x4g krb5kdc[1454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232025, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:45.659765 1989 init.cc:377] Logged in from keytab as oryx/127.26.207.253@KRBTEST.COM (short username oryx)
I20260808 23:33:45.661441 1989 webserver.cc:460] Webserver started at http://127.26.207.253:39245/ using document root <none> and password file <none>
I20260808 23:33:45.661909 1989 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:45.662001 1989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:45.665728 1989 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:33:45.673574 2118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:45.674279 1989 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.005s sys 0.003s
I20260808 23:33:45.674503 1989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/wal
uuid: "fed0120785684cec9aa6afa46f6058b7"
format_stamp: "Formatted at 2026-08-08 23:33:45 on dist-test-slave-1x4g"
server_key: "930d59146688418ab0b3f1861d4cc694"
server_key_iv: "35415b750ca80f2d1c0121e7525f7482"
server_key_version: "encryptionkey@0"
I20260808 23:33:45.674782 1989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:45.684461 1983 heartbeater.cc:503] Master 127.26.207.254:40267 was elected leader, sending a full tablet report...
I20260808 23:33:45.743168 1989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:45.749486 1989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:45.811488 1989 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.253:46827
I20260808 23:33:45.811502 2171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.253:46827 every 8 connection(s)
I20260808 23:33:45.812853 1989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-1/data/info.pb
I20260808 23:33:45.820714 2172 sys_catalog.cc:263] Verifying existing consensus state
I20260808 23:33:45.826336 2172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: Bootstrap starting.
I20260808 23:33:45.862097 2172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 23:33:45.863030 2172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: Bootstrap complete.
I20260808 23:33:45.864535 2172 raft_consensus.cc:348] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: NON_VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: true } }
I20260808 23:33:45.865069 2172 raft_consensus.cc:729] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fed0120785684cec9aa6afa46f6058b7, State: Initialized, Role: LEARNER
I20260808 23:33:45.865541 2172 consensus_queue.cc:260] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: NON_VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: true } }
I20260808 23:33:45.867867 2172 sys_catalog.cc:564] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:33:45.867126 2175 sys_catalog.cc:455] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: NON_VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: true } } }
I20260808 23:33:45.868178 2175 sys_catalog.cc:458] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: This master's current role is: LEARNER
I20260808 23:33:45.883659 2187 catalog_manager.cc:1259] Loaded cluster ID: 734291609f0d48a19740bd2b3f1e023f
I20260808 23:33:45.883899 2187 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: loading cluster ID for follower catalog manager: success
I20260808 23:33:45.888319 2187 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: acquiring CA information for follower catalog manager: success
I20260808 23:33:45.892099 2187 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 23:33:45.983351 2089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:45.970918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:46827 (local address 127.0.0.1:58110)
0808 23:33:45.971148 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:45.971174 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:45.971344 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:45.973029 (+ 1685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:45.973038 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:45.973085 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:45.973312 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:45.973328 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.976087 (+ 2759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.976095 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:45.978770 (+ 2675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:45.978802 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.981039 (+ 2237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.981047 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:45.981687 (+ 640us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:45.981796 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 23:33:45.982250 (+ 454us) client_negotiation.cc:240] Negotiation successful
0808 23:33:45.982742 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 23:33:45.984068 2188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:45.971575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58110 (local address 127.26.207.253:46827)
0808 23:33:45.972494 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:45.972500 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:45.972524 (+ 24us) server_negotiation.cc:407] Connection header received
0808 23:33:45.972606 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:45.972611 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:45.972714 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:45.972933 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:45.973524 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.975881 (+ 2357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.979049 (+ 3168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:45.980655 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:45.981037 (+ 382us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:45.981265 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:45.983155 (+ 1890us) server_negotiation.cc:299] Negotiation successful
0808 23:33:45.983343 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":766,"thread_start_us":548,"threads_started":1}
I20260808 23:33:45.986225 2147 raft_consensus.cc:1203] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260808 23:33:45.987566 2175 sys_catalog.cc:455] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9362a636eb74053afc1aa98c2ec8788. Latest consensus state: current_term: 1 leader_uuid: "e9362a636eb74053afc1aa98c2ec8788" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: NON_VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: true } } }
I20260808 23:33:45.987911 2175 sys_catalog.cc:458] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: This master's current role is: LEARNER
W20260808 23:33:46.066875 2098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:46.067312 2098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:46.067474 2098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:46.076833 2098 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:33:46.077010 2098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:46.077119 2098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:46.077230 2098 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:33:46.077319 2098 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:33:46.089689 2098 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:40267,127.26.207.253:46827,127.26.207.252:36471
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.252.keytab
--principal=oryx/127.26.207.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.252:36471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.207.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:46.091341 2098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:46.092825 2098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:46.109280 2193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:46.109248 2194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:46.109385 2196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:46.114826 2098 server_base.cc:1034] running on GCE node
I20260808 23:33:46.115914 2098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:46.117801 2098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:46.119091 2098 hybrid_clock.cc:648] HybridClock initialized: now 1786232026119021 us; error 59 us; skew 500 ppm
I20260808 23:33:46.119633 2098 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:46 dist-test-slave-1x4g krb5kdc[1454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232026, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:46.123809 2098 init.cc:377] Logged in from keytab as oryx/127.26.207.252@KRBTEST.COM (short username oryx)
I20260808 23:33:46.126048 2098 webserver.cc:460] Webserver started at http://127.26.207.252:37253/ using document root <none> and password file <none>
I20260808 23:33:46.126885 2098 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:46.127053 2098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:46.127416 2098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:46.130815 2098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/data/instance:
uuid: "c73ba41125ef45d09943840f0dd199c2"
format_stamp: "Formatted at 2026-08-08 23:33:46 on dist-test-slave-1x4g"
server_key: "f81336c1d445b109150ea233a0c468fe"
server_key_iv: "2cb7bcefac6a9afe3f16794958f6c860"
server_key_version: "encryptionkey@0"
I20260808 23:33:46.131726 2098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/wal/instance:
uuid: "c73ba41125ef45d09943840f0dd199c2"
format_stamp: "Formatted at 2026-08-08 23:33:46 on dist-test-slave-1x4g"
server_key: "f81336c1d445b109150ea233a0c468fe"
server_key_iv: "2cb7bcefac6a9afe3f16794958f6c860"
server_key_version: "encryptionkey@0"
I20260808 23:33:46.137821 2098 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 23:33:46.141842 2203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:46.143368 2098 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:33:46.143601 2098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/wal
uuid: "c73ba41125ef45d09943840f0dd199c2"
format_stamp: "Formatted at 2026-08-08 23:33:46 on dist-test-slave-1x4g"
server_key: "f81336c1d445b109150ea233a0c468fe"
server_key_iv: "2cb7bcefac6a9afe3f16794958f6c860"
server_key_version: "encryptionkey@0"
I20260808 23:33:46.143841 2098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:46.159523 2098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:46.164553 2098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:46.165088 2098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:46.191565 2098 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.252:36471
I20260808 23:33:46.191665 2259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.252:36471 every 8 connection(s)
I20260808 23:33:46.193328 2098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/data/info.pb
I20260808 23:33:46.196310 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 2098
I20260808 23:33:46.200314 2260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:46.210866 2260 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:33:46 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.207.252@KRBTEST.COM
Aug 08 23:33:46 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232026, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.252@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM
I20260808 23:33:46.228041 2264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.199214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58428 (local address 127.26.207.252:36471)
0808 23:33:46.200618 (+ 1404us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:46.200637 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:46.200726 (+ 89us) server_negotiation.cc:407] Connection header received
0808 23:33:46.203400 (+ 2674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:46.203432 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:46.204029 (+ 597us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:46.204566 (+ 537us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:46.206227 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.208428 (+ 2201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.209850 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.210951 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.211157 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.217351 (+ 6194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:46.217360 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:46.217372 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:46.217409 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:46.222284 (+ 4875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.223261 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.223271 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.223282 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.223535 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.224006 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.224014 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.224017 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.224958 (+ 941us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:46.225358 (+ 400us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:46.225664 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 23:33:46.226124 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1094,"thread_start_us":676,"threads_started":1}
I20260808 23:33:46.235049 2266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.214165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53916 (local address 127.26.207.254:40267)
0808 23:33:46.215669 (+ 1504us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:46.215676 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:46.215698 (+ 22us) server_negotiation.cc:407] Connection header received
0808 23:33:46.215766 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:46.215772 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:46.215869 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:46.216037 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:46.217342 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.218316 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.221321 (+ 3005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.221758 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.221871 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.227372 (+ 5501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:46.227381 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:46.227385 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:46.227436 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:46.231494 (+ 4058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.232484 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.232490 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.232494 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.232727 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.233209 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.233214 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.233217 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.233577 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:46.233762 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:46.234269 (+ 507us) server_negotiation.cc:299] Negotiation successful
0808 23:33:46.234520 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1363,"thread_start_us":1246,"threads_started":1}
I20260808 23:33:46.235208 2265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.214061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:53916)
0808 23:33:46.215032 (+ 971us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:46.215091 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:46.215319 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:46.216111 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:46.216117 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:46.216836 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:46.217170 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.217185 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.218611 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.218650 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.221131 (+ 2481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.221150 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.222032 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.222042 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.222294 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.223197 (+ 903us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:46.223227 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:46.227064 (+ 3837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:46.231681 (+ 4617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:46.231693 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:46.231701 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:46.232325 (+ 624us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:46.232909 (+ 584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:46.232914 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:46.232918 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:46.233075 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:46.233747 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:46.233756 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:46.233949 (+ 193us) client_negotiation.cc:769] Sending connection context
0808 23:33:46.234154 (+ 205us) client_negotiation.cc:240] Negotiation successful
0808 23:33:46.234520 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":388,"threads_started":1}
I20260808 23:33:46.237012 2260 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:33:46 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232026, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.252@KRBTEST.COM for oryx/127.26.207.253@KRBTEST.COM
I20260808 23:33:46.253859 2188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.238239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58124 (local address 127.26.207.253:46827)
0808 23:33:46.238490 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:46.238498 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:46.238613 (+ 115us) server_negotiation.cc:407] Connection header received
0808 23:33:46.238823 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:46.238827 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:46.238891 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:46.238998 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:46.240012 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.240939 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.242590 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.243024 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.243179 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.247254 (+ 4075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:46.247259 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:46.247263 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:46.247300 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:46.250554 (+ 3254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.251546 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.251552 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.251558 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.251705 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.252208 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.252213 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.252218 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.252536 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:46.252713 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:46.253188 (+ 475us) server_negotiation.cc:299] Negotiation successful
0808 23:33:46.253459 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 23:33:46.253947 2265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.238210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:46827 (local address 127.0.0.1:58124)
0808 23:33:46.238510 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:46.238534 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:46.238691 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:46.239023 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:46.239027 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:46.239588 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:46.239850 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.239860 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.241078 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.241090 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.242415 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.242429 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.243198 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.243204 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.243451 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.244259 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:46.244278 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:46.247015 (+ 2737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:46.250755 (+ 3740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:46.250761 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:46.250765 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:46.251402 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:46.251832 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:46.251837 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:46.251842 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:46.252076 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:46.252676 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:46.252680 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:46.252914 (+ 234us) client_negotiation.cc:769] Sending connection context
0808 23:33:46.253063 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 23:33:46.253475 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86}
I20260808 23:33:46.255405 2260 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:33:46 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232026, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.252@KRBTEST.COM for oryx/127.26.207.252@KRBTEST.COM
I20260808 23:33:46.271435 2265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.256643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36471 (local address 127.0.0.1:58434)
0808 23:33:46.256758 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:46.256813 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:46.256926 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:46.257196 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:46.257199 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:46.257655 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:46.257896 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.257905 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.259282 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.259285 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.260438 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.260451 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.261470 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.261474 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.261649 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.262340 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:46.262359 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:46.265134 (+ 2775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:46.268663 (+ 3529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:46.268668 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:46.268671 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:46.269282 (+ 611us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:46.269741 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:46.269745 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:46.269748 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:46.269935 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:46.270507 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:46.270511 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:46.270665 (+ 154us) client_negotiation.cc:769] Sending connection context
0808 23:33:46.270785 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 23:33:46.271032 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 23:33:46.271826 2264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.256324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58434 (local address 127.26.207.252:36471)
0808 23:33:46.256547 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:46.256554 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:46.256917 (+ 363us) server_negotiation.cc:407] Connection header received
0808 23:33:46.257009 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:46.257013 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:46.257077 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:46.257162 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:46.258037 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.259150 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.260582 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.261311 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.261426 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.265425 (+ 3999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:46.265430 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:46.265434 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:46.265468 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:46.268471 (+ 3003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.269420 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.269424 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.269427 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.269619 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.270053 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.270057 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.270059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.270389 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:46.270509 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:46.270898 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 23:33:46.271195 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":73,"server-negotiator.queue_time_us":101}
I20260808 23:33:46.278858 2260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: Bootstrap starting.
I20260808 23:33:46.283109 2260 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:46.284502 2260 log.cc:824] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:46.287917 2260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: No bootstrap required, opened a new log
I20260808 23:33:46.297667 2260 raft_consensus.cc:348] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } }
I20260808 23:33:46.298070 2260 raft_consensus.cc:374] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:46.298223 2260 raft_consensus.cc:729] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73ba41125ef45d09943840f0dd199c2, State: Initialized, Role: FOLLOWER
I20260808 23:33:46.298866 2260 consensus_queue.cc:260] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } }
I20260808 23:33:46.300146 2268 sys_catalog.cc:455] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } } }
I20260808 23:33:46.300648 2268 sys_catalog.cc:458] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:33:46.301760 2260 sys_catalog.cc:564] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 23:33:46.313421 2281 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 23:33:46.313607 2281 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 23:33:46.319049 2098 master_runner.cc:428] Detected that this master c73ba41125ef45d09943840f0dd199c2 is joining an existing cluster
I20260808 23:33:46.319304 2098 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.207.252:36471
I20260808 23:33:46.336920 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 1567
I20260808 23:33:46.358157 2289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.326076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:46827 (local address 127.0.0.1:58140)
0808 23:33:46.330423 (+ 4347us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:46.330455 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:46.331273 (+ 818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:46.332090 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:46.332098 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:46.333562 (+ 1464us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:46.334309 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.334326 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.336671 (+ 2345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.336678 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.344089 (+ 7411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.344110 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.345548 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.345555 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.345820 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.346682 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:46.346707 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:46.348316 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:46.353447 (+ 5131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:46.353452 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:46.353457 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:46.354116 (+ 659us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:46.354715 (+ 599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:46.354720 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:46.354724 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:46.354980 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:46.355969 (+ 989us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:46.355977 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:46.356347 (+ 370us) client_negotiation.cc:769] Sending connection context
0808 23:33:46.356548 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 23:33:46.357424 (+ 876us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4097,"thread_start_us":8684,"threads_started":1}
I20260808 23:33:46.360390 2188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.325476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58140 (local address 127.26.207.253:46827)
0808 23:33:46.325717 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:46.325722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:46.330610 (+ 4888us) server_negotiation.cc:407] Connection header received
0808 23:33:46.331517 (+ 907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:46.331527 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:46.331650 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:46.331748 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:46.334789 (+ 3041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.335672 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.344333 (+ 8661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.345098 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.345248 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.348587 (+ 3339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:46.348594 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:46.348600 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:46.348653 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:46.353281 (+ 4628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.354311 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.354317 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.354321 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.354569 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.355136 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.355141 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.355145 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.355520 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:46.358470 (+ 2950us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:46.358701 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 23:33:46.359075 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 23:33:46.368584 2288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.326414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36471 (local address 127.0.0.1:58440)
0808 23:33:46.336227 (+ 9813us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:46.336249 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:46.336461 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:46.337912 (+ 1451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:46.337920 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:46.341249 (+ 3329us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:46.349166 (+ 7917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.349182 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.350960 (+ 1778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.350974 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.353446 (+ 2472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.353463 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.355154 (+ 1691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.355161 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.355351 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.356037 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:46.356060 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:46.357876 (+ 1816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:46.364562 (+ 6686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:46.364568 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:46.364571 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:46.365388 (+ 817us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:46.365887 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:46.365891 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:46.365895 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:46.366135 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:46.366996 (+ 861us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:46.367001 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:46.367246 (+ 245us) client_negotiation.cc:769] Sending connection context
0808 23:33:46.367404 (+ 158us) client_negotiation.cc:240] Negotiation successful
0808 23:33:46.368034 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9631,"thread_start_us":4233,"threads_started":1}
I20260808 23:33:46.368822 2264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.326396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58440 (local address 127.26.207.252:36471)
0808 23:33:46.326676 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:46.326683 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:46.336359 (+ 9676us) server_negotiation.cc:407] Connection header received
0808 23:33:46.337534 (+ 1175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:46.337540 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:46.337637 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:46.337716 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:46.349343 (+ 11627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.350753 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.353616 (+ 2863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.354555 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.354661 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.358104 (+ 3443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:46.358110 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:46.358115 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:46.358156 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:46.364399 (+ 6243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.365526 (+ 1127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.365531 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.365534 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.365740 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.366299 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.366305 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.366312 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.366817 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:46.367056 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:46.367625 (+ 569us) server_negotiation.cc:299] Negotiation successful
0808 23:33:46.368270 (+ 645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":306,"server-negotiator.queue_time_us":72}
Aug 08 23:33:46 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.207.193@KRBTEST.COM
I20260808 23:33:46.371690 2290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.327300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:53926)
0808 23:33:46.344126 (+ 16826us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:46.344164 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:46.344353 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:46.345218 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:46.345222 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:46.346122 (+ 900us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:46.350695 (+ 4573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.350711 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.352626 (+ 1915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.352631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.354744 (+ 2113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.354760 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.356215 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.356226 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.356413 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.357247 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:46.357276 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:46.358733 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:46.364161 (+ 5428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:46.364166 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:46.364170 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:46.364801 (+ 631us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:46.365319 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:46.365323 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:46.365326 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:46.365564 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:46.370385 (+ 4821us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:46.370391 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:46.370665 (+ 274us) client_negotiation.cc:769] Sending connection context
0808 23:33:46.370837 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 23:33:46.371176 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16534,"mutex_wait_us":49,"thread_start_us":16145,"threads_started":1}
I20260808 23:33:46.371690 2266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.325146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53926 (local address 127.26.207.254:40267)
0808 23:33:46.325444 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:46.325451 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:46.344645 (+ 19194us) server_negotiation.cc:407] Connection header received
0808 23:33:46.344741 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:46.344747 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:46.344902 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:46.345015 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:46.350957 (+ 5942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.352412 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.354958 (+ 2546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.355694 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.355802 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.358993 (+ 3191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:46.359000 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:46.359005 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:46.359048 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:46.363940 (+ 4892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.364970 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.364976 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.364979 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.365170 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.365736 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.365743 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.365749 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.370231 (+ 4482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:46.370455 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:46.371031 (+ 576us) server_negotiation.cc:299] Negotiation successful
0808 23:33:46.371317 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260808 23:33:46.381314 2291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.339093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40330 (local address 127.26.207.193:44589)
0808 23:33:46.342481 (+ 3388us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:46.342490 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:46.342521 (+ 31us) server_negotiation.cc:407] Connection header received
0808 23:33:46.342585 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:46.342591 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:46.342813 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:46.342961 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:46.345641 (+ 2680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.347361 (+ 1720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.363196 (+ 15835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.364673 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.365848 (+ 1175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.372580 (+ 6732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:46.372604 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:46.372626 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:46.372680 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:46.377042 (+ 4362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.377852 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.377864 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.377868 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.378065 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.378688 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.378694 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.378701 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.379196 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:46.379524 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:46.380417 (+ 893us) server_negotiation.cc:299] Negotiation successful
0808 23:33:46.380729 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3198,"thread_start_us":2986,"threads_started":1}
I20260808 23:33:46.382963 1695 generic_service.cc:196] Checking for leaks (request via RPC)
Aug 08 23:33:46 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232022, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.254@KRBTEST.COM for oryx/127.26.207.252@KRBTEST.COM
I20260808 23:33:46.398730 2089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.378255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36471 (local address 127.0.0.1:58442)
0808 23:33:46.378452 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:46.378473 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:46.378600 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:46.379326 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:46.379332 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:46.379772 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:46.379932 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.379940 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.381689 (+ 1749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.381695 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.383577 (+ 1882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.383597 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.384809 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.384817 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.385387 (+ 570us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.386179 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:46.386204 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:46.389796 (+ 3592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:46.394874 (+ 5078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:46.394882 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:46.394886 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:46.395631 (+ 745us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:46.396358 (+ 727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:46.396365 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:46.396369 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:46.396559 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:46.397552 (+ 993us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:46.397557 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:46.397771 (+ 214us) client_negotiation.cc:769] Sending connection context
0808 23:33:46.397948 (+ 177us) client_negotiation.cc:240] Negotiation successful
0808 23:33:46.398302 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 23:33:46.399240 2264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.378795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58442 (local address 127.26.207.252:36471)
0808 23:33:46.378969 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:46.378974 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:46.378989 (+ 15us) server_negotiation.cc:407] Connection header received
0808 23:33:46.379076 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:46.379080 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:46.379172 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:46.379284 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:46.380118 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.381555 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.383799 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.384592 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.385743 (+ 1151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.390100 (+ 4357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:46.390107 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:46.390112 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:46.390162 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:46.394648 (+ 4486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.395842 (+ 1194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.395851 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.395856 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.396179 (+ 323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.396721 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.396728 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.396732 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.397388 (+ 656us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:46.397585 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:46.398133 (+ 548us) server_negotiation.cc:299] Negotiation successful
0808 23:33:46.398422 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 23:33:46.400918 1501 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.207.252:36471: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "c73ba41125ef45d09943840f0dd199c2"
member_type: NON_VOTER
last_known_addr {
host: "127.26.207.252"
port: 36471
}
attrs {
promote: true
}
}
dest_uuid: "e9362a636eb74053afc1aa98c2ec8788"
cas_config_opid_index: 5
I20260808 23:33:46.402084 1501 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: NON_VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: true } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: NON_VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: true } }
I20260808 23:33:46.404052 2092 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER c73ba41125ef45d09943840f0dd199c2 (127.26.207.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: NON_VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: true } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: NON_VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: true } } }
I20260808 23:33:46.407989 2092 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.207.252:36471
I20260808 23:33:46.408949 2098 master.cc:537] Master@127.26.207.252:36471 shutting down...
I20260808 23:33:46.409343 2147 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 1 LEARNER]: Refusing update from remote peer e9362a636eb74053afc1aa98c2ec8788: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 23:33:46.413461 2293 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e9362a636eb74053afc1aa98c2ec8788" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: NON_VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: true } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: NON_VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: true } } }
I20260808 23:33:46.413998 2293 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:46.412874 2092 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: NON_VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260808 23:33:46.417658 2209 tablet.cc:2369] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:33:46.427955 2147 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER c73ba41125ef45d09943840f0dd199c2 (127.26.207.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: NON_VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: true } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: NON_VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: true } } }
I20260808 23:33:46.432755 2175 sys_catalog.cc:455] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e9362a636eb74053afc1aa98c2ec8788" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: NON_VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: true } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: NON_VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: true } } }
I20260808 23:33:46.433097 2175 sys_catalog.cc:458] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: This master's current role is: LEARNER
I20260808 23:33:46.434397 2293 raft_consensus.cc:1050] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788: attempting to promote NON_VOTER fed0120785684cec9aa6afa46f6058b7 to VOTER
W20260808 23:33:46.434580 1485 consensus_peers.cc:487] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 -> Peer c73ba41125ef45d09943840f0dd199c2 (127.26.207.252:36471): Couldn't send request to peer c73ba41125ef45d09943840f0dd199c2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 23:33:46.435338 2293 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: NON_VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: true } }
I20260808 23:33:46.437647 2147 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 1 LEARNER]: Refusing update from remote peer e9362a636eb74053afc1aa98c2ec8788: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 23:33:46.438405 2092 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260808 23:33:46.438933 1485 consensus_peers.cc:487] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 -> Peer c73ba41125ef45d09943840f0dd199c2 (127.26.207.252:36471): Couldn't send request to peer c73ba41125ef45d09943840f0dd199c2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 23:33:46.441004 2293 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, fed0120785684cec9aa6afa46f6058b7 (127.26.207.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: NON_VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: true } } }
I20260808 23:33:46.446233 2147 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, fed0120785684cec9aa6afa46f6058b7 (127.26.207.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: NON_VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: true } } }
I20260808 23:33:46.447611 2098 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:46.448062 2098 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:46.448278 2098 tablet_replica.cc:330] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: stopping tablet replica
I20260808 23:33:46.445760 2294 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e9362a636eb74053afc1aa98c2ec8788" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: NON_VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: true } } }
I20260808 23:33:46.451377 2294 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:46.445744 2293 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e9362a636eb74053afc1aa98c2ec8788" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: NON_VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: true } } }
I20260808 23:33:46.451813 2293 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:46.452848 2175 sys_catalog.cc:455] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e9362a636eb74053afc1aa98c2ec8788" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: NON_VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: true } } }
I20260808 23:33:46.453116 2175 sys_catalog.cc:458] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:33:46.456702 2098 master.cc:552] Master@127.26.207.252:36471 shutdown complete.
I20260808 23:33:46.456825 2098 master_runner.cc:305] Clearing existing system tablet
I20260808 23:33:46.457242 2098 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:46.457360 2098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:46.460673 2098 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 23:33:46.462631 2299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:46.463068 2098 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:46.463567 2098 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 23:33:46.463759 2098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/wal
uuid: "c73ba41125ef45d09943840f0dd199c2"
format_stamp: "Formatted at 2026-08-08 23:33:46 on dist-test-slave-1x4g"
server_key: "f81336c1d445b109150ea233a0c468fe"
server_key_iv: "2cb7bcefac6a9afe3f16794958f6c860"
server_key_version: "encryptionkey@0"
I20260808 23:33:46.469514 2098 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:46.478638 2098 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 23:33:46.478986 2098 log.cc:1196] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 23:33:46.479622 2098 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: Deleting consensus metadata
I20260808 23:33:46.479944 2098 master_runner.cc:315] Copying system tablet from 127.26.207.254:40267
I20260808 23:33:46.486840 2098 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: tablet copy: Beginning tablet copy session from remote peer at address 127.26.207.254:40267
I20260808 23:33:46.505049 2266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.487986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53932 (local address 127.26.207.254:40267)
0808 23:33:46.488390 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:46.488400 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:46.489745 (+ 1345us) server_negotiation.cc:407] Connection header received
0808 23:33:46.489998 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:46.490003 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:46.490084 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:46.490206 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:46.491221 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.492281 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.494038 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.494806 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.494957 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.497223 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:46.497236 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:46.497239 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:46.497273 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:46.501364 (+ 4091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.502243 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.502249 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.502253 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.502499 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:46.503060 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:46.503064 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:46.503066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:46.503510 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:46.503702 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:46.504269 (+ 567us) server_negotiation.cc:299] Negotiation successful
0808 23:33:46.504514 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229}
I20260808 23:33:46.505126 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.487952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:53932)
0808 23:33:46.489576 (+ 1624us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:46.489596 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:46.489833 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:46.490240 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:46.490245 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:46.490775 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:46.491039 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.491049 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.492520 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.492526 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.493851 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.493867 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.494980 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.494986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.495228 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.496009 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:46.496030 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:46.496998 (+ 968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:46.501594 (+ 4596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:46.501598 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:46.501602 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:46.502095 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:46.502643 (+ 548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:46.502648 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:46.502652 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:46.502870 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:46.503656 (+ 786us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:46.503661 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:46.503901 (+ 240us) client_negotiation.cc:769] Sending connection context
0808 23:33:46.504049 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 23:33:46.504436 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1495,"thread_start_us":1259,"threads_started":1}
I20260808 23:33:46.506402 1522 tablet_copy_service.cc:140] P e9362a636eb74053afc1aa98c2ec8788: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer c73ba41125ef45d09943840f0dd199c2 ({username='oryx', principal='oryx/127.26.207.252@KRBTEST.COM'} at 127.0.0.1:53932)
I20260808 23:33:46.506637 1522 tablet_copy_service.cc:161] P e9362a636eb74053afc1aa98c2ec8788: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer c73ba41125ef45d09943840f0dd199c2 at {username='oryx', principal='oryx/127.26.207.252@KRBTEST.COM'} at 127.0.0.1:53932: session id = c73ba41125ef45d09943840f0dd199c2-00000000000000000000000000000000
I20260808 23:33:46.509526 1522 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 23:33:46.511678 2098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 23:33:46.517307 2098 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: tablet copy: Starting download of 0 data blocks...
I20260808 23:33:46.517640 2098 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: tablet copy: Starting download of 1 WAL segments...
I20260808 23:33:46.520630 2098 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 23:33:46.524351 1522 tablet_copy_service.cc:342] P e9362a636eb74053afc1aa98c2ec8788: Request end of tablet copy session c73ba41125ef45d09943840f0dd199c2-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.207.252@KRBTEST.COM'} at 127.0.0.1:53932
I20260808 23:33:46.524530 1522 tablet_copy_service.cc:433] P e9362a636eb74053afc1aa98c2ec8788: ending tablet copy session c73ba41125ef45d09943840f0dd199c2-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer c73ba41125ef45d09943840f0dd199c2
I20260808 23:33:46.529488 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 1567
I20260808 23:33:46.537135 2098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:46.540141 2306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:46.542377 2307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:46.558519 2309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:46.558806 2098 server_base.cc:1034] running on GCE node
I20260808 23:33:46.559208 2098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:46.559932 2098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:46.560632 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:44589
--local_ip_for_outbound_sockets=127.26.207.193
--tserver_master_addrs=127.26.207.254:40267
--webserver_port=38379
--webserver_interface=127.26.207.193
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.193.keytab
--principal=oryx/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.207.254:40267,127.26.207.253:46827
--tserver_master_addrs=127.26.207.254:40267,127.26.207.253:46827,127.26.207.252:36471 with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:33:46.567399 2098 hybrid_clock.cc:648] HybridClock initialized: now 1786232026567335 us; error 39 us; skew 500 ppm
I20260808 23:33:46.567850 2098 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:46 dist-test-slave-1x4g krb5kdc[1454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232026, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:46.570253 2098 init.cc:377] Logged in from keytab as oryx/127.26.207.252@KRBTEST.COM (short username oryx)
I20260808 23:33:46.573160 2098 webserver.cc:460] Webserver started at http://127.26.207.252:40937/ using document root <none> and password file <none>
I20260808 23:33:46.573580 2098 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:46.573695 2098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:46.577550 2098 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:33:46.579998 2318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:46.580636 2098 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 23:33:46.580803 2098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/wal
uuid: "c73ba41125ef45d09943840f0dd199c2"
format_stamp: "Formatted at 2026-08-08 23:33:46 on dist-test-slave-1x4g"
server_key: "f81336c1d445b109150ea233a0c468fe"
server_key_iv: "2cb7bcefac6a9afe3f16794958f6c860"
server_key_version: "encryptionkey@0"
I20260808 23:33:46.581035 2098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:46.598891 2098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:46.603300 2098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:46.629411 2098 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.252:36471
I20260808 23:33:46.629609 2371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.252:36471 every 8 connection(s)
I20260808 23:33:46.630544 2098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/master-2/data/info.pb
I20260808 23:33:46.636515 2372 sys_catalog.cc:263] Verifying existing consensus state
I20260808 23:33:46.640762 2372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: Bootstrap starting.
I20260808 23:33:46.661397 2372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 23:33:46.662073 2372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: Bootstrap complete.
I20260808 23:33:46.663301 2372 raft_consensus.cc:348] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: NON_VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: true } }
I20260808 23:33:46.663630 2372 raft_consensus.cc:729] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c73ba41125ef45d09943840f0dd199c2, State: Initialized, Role: LEARNER
I20260808 23:33:46.663904 2372 consensus_queue.cc:260] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: NON_VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: true } }
I20260808 23:33:46.664863 2375 sys_catalog.cc:455] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: NON_VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: true } } }
I20260808 23:33:46.665217 2372 sys_catalog.cc:564] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:33:46.665341 2375 sys_catalog.cc:458] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [sys.catalog]: This master's current role is: LEARNER
I20260808 23:33:46.678613 2387 catalog_manager.cc:1259] Loaded cluster ID: 734291609f0d48a19740bd2b3f1e023f
I20260808 23:33:46.678759 2387 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: loading cluster ID for follower catalog manager: success
I20260808 23:33:46.681815 2387 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: acquiring CA information for follower catalog manager: success
I20260808 23:33:46.683802 2387 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 23:33:46.825991 2089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.816537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36471 (local address 127.0.0.1:58444)
0808 23:33:46.816892 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:46.816915 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:46.817081 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:46.818139 (+ 1058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:46.818145 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:46.818185 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:46.818410 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.818432 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.820970 (+ 2538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.820977 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.823185 (+ 2208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:46.823206 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.825151 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.825158 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:46.825402 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.825443 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 23:33:46.825514 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 23:33:46.825670 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194}
I20260808 23:33:46.827636 2388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:46.816743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58444 (local address 127.26.207.252:36471)
0808 23:33:46.817730 (+ 987us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:46.817736 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:46.817756 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:33:46.817838 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:46.817844 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:46.817932 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:46.818657 (+ 725us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:46.818899 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.820763 (+ 1864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.823463 (+ 2700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:46.824915 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:46.826832 (+ 1917us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:46.827052 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:46.827114 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 23:33:46.827262 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":837,"thread_start_us":573,"threads_started":1}
I20260808 23:33:46.837996 2347 raft_consensus.cc:1203] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 23:33:46.839115 2375 sys_catalog.cc:455] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9362a636eb74053afc1aa98c2ec8788. Latest consensus state: current_term: 1 leader_uuid: "e9362a636eb74053afc1aa98c2ec8788" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: NON_VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: true } } }
I20260808 23:33:46.839443 2375 sys_catalog.cc:458] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [sys.catalog]: This master's current role is: LEARNER
W20260808 23:33:47.024693 2314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:47.025118 2314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:47.025280 2314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:47.033111 2314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:47.033243 2314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:47.033435 2314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:33:47.043941 2314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.193.keytab
--principal=oryx/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:44589
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=38379
--tserver_master_addrs=127.26.207.254:40267,127.26.207.253:46827,127.26.207.252:36471
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:47.045481 2314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:47.047065 2314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:47.062192 2395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:47.062263 2394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:47.062259 2397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:47.066530 2314 server_base.cc:1034] running on GCE node
I20260808 23:33:47.067273 2314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:47.068643 2314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:47.069902 2314 hybrid_clock.cc:648] HybridClock initialized: now 1786232027069816 us; error 62 us; skew 500 ppm
I20260808 23:33:47.070276 2314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:47 dist-test-slave-1x4g krb5kdc[1454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232027, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:47.074026 2314 init.cc:377] Logged in from keytab as oryx/127.26.207.193@KRBTEST.COM (short username oryx)
I20260808 23:33:47.076090 2314 webserver.cc:460] Webserver started at http://127.26.207.193:38379/ using document root <none> and password file <none>
I20260808 23:33:47.077090 2314 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:47.077252 2314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:47.083997 2314 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 23:33:47.087248 2404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:47.088971 2314 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:33:47.089179 2314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2"
format_stamp: "Formatted at 2026-08-08 23:33:43 on dist-test-slave-1x4g"
server_key: "502ff9d3950c7cd1f0b59bba75a131e6"
server_key_iv: "77399091cee9234ac7993b4ec8b37721"
server_key_version: "encryptionkey@0"
I20260808 23:33:47.090303 2314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:47.111923 2314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:47.117695 2314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:47.118076 2314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:47.119382 2314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:47.121155 2314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:47.121316 2314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:47.121470 2314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:47.121676 2314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:47.170898 2314 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:44589
I20260808 23:33:47.170995 2520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:44589 every 8 connection(s)
I20260808 23:33:47.172484 2314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:33:47.179023 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 2314
I20260808 23:33:47.179491 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 1707
Aug 08 23:33:47 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.207.194@KRBTEST.COM
Aug 08 23:33:47 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232027, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM
Aug 08 23:33:47 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232027, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.253@KRBTEST.COM
Aug 08 23:33:47 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232027, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.252@KRBTEST.COM
I20260808 23:33:47.222288 2533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:47.182083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45872 (local address 127.26.207.194:36475)
0808 23:33:47.183246 (+ 1163us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:47.183260 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:47.194177 (+ 10917us) server_negotiation.cc:407] Connection header received
0808 23:33:47.194474 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:47.194487 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:47.194887 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:47.195075 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:47.198996 (+ 3921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.200692 (+ 1696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.202911 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.204253 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.204388 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:47.212535 (+ 8147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:47.212554 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:47.212572 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:47.212646 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:47.216514 (+ 3868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:47.217826 (+ 1312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:47.217836 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:47.217840 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:47.218207 (+ 367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:47.218894 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:47.218901 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:47.218905 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:47.219436 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:47.219825 (+ 389us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:47.221193 (+ 1368us) server_negotiation.cc:299] Negotiation successful
0808 23:33:47.221644 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":895,"thread_start_us":1214,"threads_started":1}
I20260808 23:33:47.224156 1839 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:47.231777 2529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:47.178410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:54711 (local address 127.26.207.254:40267)
0808 23:33:47.197686 (+ 19276us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:47.197695 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:47.197722 (+ 27us) server_negotiation.cc:407] Connection header received
0808 23:33:47.197799 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:47.197806 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:47.197896 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:47.200816 (+ 2920us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:47.201053 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.202301 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.210231 (+ 7930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.211212 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.211376 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:47.219595 (+ 8219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:47.219605 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:47.219609 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:47.219669 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:47.224011 (+ 4342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:47.228745 (+ 4734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:47.228749 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:47.228752 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:47.228970 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:47.229521 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:47.229526 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:47.229528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:47.229821 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:47.230012 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:47.231037 (+ 1025us) server_negotiation.cc:299] Negotiation successful
0808 23:33:47.231322 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19101,"thread_start_us":18945,"threads_started":1}
I20260808 23:33:47.232127 2388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:47.176922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:55241 (local address 127.26.207.252:36471)
0808 23:33:47.177120 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:47.177126 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:47.206656 (+ 29530us) server_negotiation.cc:407] Connection header received
0808 23:33:47.206956 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:47.206962 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:47.207056 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:47.207142 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:47.208911 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.210285 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.213541 (+ 3256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.214262 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.214340 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:47.223452 (+ 9112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:47.223462 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:47.223467 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:47.223527 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:47.228115 (+ 4588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:47.229296 (+ 1181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:47.229304 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:47.229310 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:47.229488 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:47.229937 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:47.229942 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:47.229945 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:47.230292 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:47.230453 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:47.231027 (+ 574us) server_negotiation.cc:299] Negotiation successful
0808 23:33:47.231447 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 23:33:47.233168 2534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:47.177698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.193:54711)
0808 23:33:47.189891 (+ 12193us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:47.189968 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:47.196984 (+ 7016us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:47.198561 (+ 1577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:47.198580 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:47.199629 (+ 1049us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:47.200527 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:47.200564 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.202591 (+ 2027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.202599 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:47.205565 (+ 2966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:47.205587 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.212601 (+ 7014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.212609 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:47.213033 (+ 424us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:47.214702 (+ 1669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:47.214738 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:47.219196 (+ 4458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:47.224717 (+ 5521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:47.224732 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:47.226171 (+ 1439us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:47.228582 (+ 2411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:47.229107 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:47.229113 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:47.229117 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:47.229380 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:47.230159 (+ 779us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:47.230163 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:47.230419 (+ 256us) client_negotiation.cc:769] Sending connection context
0808 23:33:47.230899 (+ 480us) client_negotiation.cc:240] Negotiation successful
0808 23:33:47.231529 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11698,"thread_start_us":16723,"threads_started":1}
I20260808 23:33:47.233528 2531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:47.182975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36471 (local address 127.26.207.193:55241)
0808 23:33:47.206523 (+ 23548us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:47.206552 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:47.206790 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:47.207387 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:47.207391 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:47.208165 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:47.208664 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:47.208682 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.210561 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.210569 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:47.212286 (+ 1717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:47.212301 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.216797 (+ 4496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.216805 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:47.217016 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:47.218665 (+ 1649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:47.218688 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:47.223129 (+ 4441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:47.228359 (+ 5230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:47.228363 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:47.228367 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:47.229140 (+ 773us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:47.229644 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:47.229648 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:47.229651 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:47.229789 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:47.230523 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:47.230529 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:47.230694 (+ 165us) client_negotiation.cc:769] Sending connection context
0808 23:33:47.232399 (+ 1705us) client_negotiation.cc:240] Negotiation successful
0808 23:33:47.232768 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23327,"thread_start_us":6151,"threads_started":1}
I20260808 23:33:47.241271 2521 heartbeater.cc:347] Connected to a master server at 127.26.207.252:36471
I20260808 23:33:47.241715 2521 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:47.242678 2521 heartbeater.cc:511] Master 127.26.207.252:36471 requested a full tablet report, sending...
I20260808 23:33:47.243521 2522 heartbeater.cc:347] Connected to a master server at 127.26.207.254:40267
I20260808 23:33:47.243769 2522 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:47.244982 2522 heartbeater.cc:511] Master 127.26.207.254:40267 requested a full tablet report, sending...
I20260808 23:33:47.245430 2527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:47.176854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:54949 (local address 127.26.207.253:46827)
0808 23:33:47.209543 (+ 32689us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:47.209548 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:47.209586 (+ 38us) server_negotiation.cc:407] Connection header received
0808 23:33:47.209639 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:47.209643 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:47.209729 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:47.209872 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:47.211427 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.212214 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.214228 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.214911 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.215112 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:47.220220 (+ 5108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:47.220238 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:47.220245 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:47.220289 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:47.226399 (+ 6110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:47.227663 (+ 1264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:47.227669 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:47.227673 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:47.227875 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:47.228656 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:47.228663 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:47.228667 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:47.229272 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:47.229995 (+ 723us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:47.244709 (+ 14714us) server_negotiation.cc:299] Negotiation successful
0808 23:33:47.245023 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32550,"thread_start_us":32382,"threads_started":1}
I20260808 23:33:47.245770 2336 ts_manager.cc:194] Registered new tserver with Master: 3dcaa86a10ba432e9ef9cfea12acc2d2 (127.26.207.193:44589)
I20260808 23:33:47.246479 2528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:47.178660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:46827 (local address 127.26.207.193:54949)
0808 23:33:47.195092 (+ 16432us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:47.195116 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:47.196419 (+ 1303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:47.209914 (+ 13495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:47.209919 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:47.210808 (+ 889us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:47.211197 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:47.211210 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.212359 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.212367 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:47.214049 (+ 1682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:47.214065 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.215182 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.215206 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:47.215462 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:47.216119 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:47.216150 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:47.219919 (+ 3769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:47.226583 (+ 6664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:47.226591 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:47.226597 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:47.227482 (+ 885us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:47.228035 (+ 553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:47.228041 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:47.228044 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:47.228447 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:47.229440 (+ 993us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:47.229449 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:47.229954 (+ 505us) client_negotiation.cc:769] Sending connection context
0808 23:33:47.243613 (+ 13659us) client_negotiation.cc:240] Negotiation successful
0808 23:33:47.243982 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16116,"thread_start_us":27250,"threads_started":1}
I20260808 23:33:47.247251 1501 ts_manager.cc:194] Re-registered known tserver with Master: 3dcaa86a10ba432e9ef9cfea12acc2d2 (127.26.207.193:44589)
I20260808 23:33:47.248485 2524 heartbeater.cc:347] Connected to a master server at 127.26.207.253:46827
I20260808 23:33:47.248595 1501 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:54711
I20260808 23:33:47.248689 2524 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:47.249462 2524 heartbeater.cc:511] Master 127.26.207.253:46827 requested a full tablet report, sending...
I20260808 23:33:47.252182 2135 ts_manager.cc:194] Registered new tserver with Master: 3dcaa86a10ba432e9ef9cfea12acc2d2 (127.26.207.193:44589)
I20260808 23:33:47.254150 2293 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e9362a636eb74053afc1aa98c2ec8788" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: NON_VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: true } } }
I20260808 23:33:47.254782 2293 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:47.257375 2536 raft_consensus.cc:1050] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788: attempting to promote NON_VOTER c73ba41125ef45d09943840f0dd199c2 to VOTER
I20260808 23:33:47.258093 2536 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } }
I20260808 23:33:47.260522 2147 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 1 FOLLOWER]: Refusing update from remote peer e9362a636eb74053afc1aa98c2ec8788: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 23:33:47.260710 2347 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 1 LEARNER]: Refusing update from remote peer e9362a636eb74053afc1aa98c2ec8788: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 23:33:47.261318 2293 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 23:33:47.261693 2537 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 23:33:47.265702 2147 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, c73ba41125ef45d09943840f0dd199c2 (127.26.207.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } } }
I20260808 23:33:47.266862 2347 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, c73ba41125ef45d09943840f0dd199c2 (127.26.207.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } } }
I20260808 23:33:47.265159 2537 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, c73ba41125ef45d09943840f0dd199c2 (127.26.207.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } } }
I20260808 23:33:47.273172 2375 sys_catalog.cc:455] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e9362a636eb74053afc1aa98c2ec8788" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } } }
I20260808 23:33:47.273595 2375 sys_catalog.cc:458] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:33:47.273720 2293 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e9362a636eb74053afc1aa98c2ec8788" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } } }
I20260808 23:33:47.274096 2293 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:47.274495 2293 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e9362a636eb74053afc1aa98c2ec8788" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } } }
I20260808 23:33:47.274792 2293 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:47.275223 2536 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e9362a636eb74053afc1aa98c2ec8788" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } } }
I20260808 23:33:47.275549 2536 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:47.276594 2540 sys_catalog.cc:455] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e9362a636eb74053afc1aa98c2ec8788" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } } }
I20260808 23:33:47.277052 2540 sys_catalog.cc:458] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:33:47.329324 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 1707
I20260808 23:33:47.349759 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:36475
--local_ip_for_outbound_sockets=127.26.207.194
--tserver_master_addrs=127.26.207.254:40267
--webserver_port=44551
--webserver_interface=127.26.207.194
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.194.keytab
--principal=oryx/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.207.254:40267,127.26.207.253:46827
--tserver_master_addrs=127.26.207.254:40267,127.26.207.253:46827,127.26.207.252:36471 with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:47.718767 2542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:47.719149 2542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:47.719331 2542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:47.728128 2542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:47.728339 2542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:47.728554 2542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:33:47.740276 2542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.194.keytab
--principal=oryx/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:36475
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=44551
--tserver_master_addrs=127.26.207.254:40267,127.26.207.253:46827,127.26.207.252:36471
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:47.741858 2542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:47.743309 2542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:47.758235 2547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:47.758291 2550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:47.758324 2548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:47.759344 2542 server_base.cc:1034] running on GCE node
I20260808 23:33:47.759984 2542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:47.761051 2542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:47.762293 2542 hybrid_clock.cc:648] HybridClock initialized: now 1786232027762233 us; error 43 us; skew 500 ppm
I20260808 23:33:47.762674 2542 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:47 dist-test-slave-1x4g krb5kdc[1454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232027, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:47.771658 2542 init.cc:377] Logged in from keytab as oryx/127.26.207.194@KRBTEST.COM (short username oryx)
I20260808 23:33:47.773669 2542 webserver.cc:460] Webserver started at http://127.26.207.194:44551/ using document root <none> and password file <none>
I20260808 23:33:47.774544 2542 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:47.774729 2542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:47.781490 2542 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 23:33:47.784730 2558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:47.786319 2542 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:33:47.786520 2542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "a7837de2d37f47c3b0f92d89fe52b99a"
format_stamp: "Formatted at 2026-08-08 23:33:43 on dist-test-slave-1x4g"
server_key: "9f1e496e1fe687cff3473e155ca5ead0"
server_key_iv: "9d1fd3c6b6df7149fc2ccd49a82c001b"
server_key_version: "encryptionkey@0"
I20260808 23:33:47.787626 2542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:47.809500 2542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:47.814437 2542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:47.814779 2542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:47.815985 2542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:47.817744 2542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:47.817869 2542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:47.817978 2542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:47.818050 2542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:47.857661 2542 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:36475
I20260808 23:33:47.857703 2676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:36475 every 8 connection(s)
I20260808 23:33:47.859385 2542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:33:47.859918 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 2542
I20260808 23:33:47.860229 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 1850
Aug 08 23:33:47 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.207.195@KRBTEST.COM
Aug 08 23:33:47 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232027, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.252@KRBTEST.COM
Aug 08 23:33:47 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232027, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM
Aug 08 23:33:47 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232027, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.253@KRBTEST.COM
I20260808 23:33:47.898995 2682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:47.861801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42992 (local address 127.26.207.195:39753)
0808 23:33:47.862853 (+ 1052us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:47.862865 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:47.866475 (+ 3610us) server_negotiation.cc:407] Connection header received
0808 23:33:47.867046 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:47.867060 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:47.867404 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:47.867594 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:47.870994 (+ 3400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.873417 (+ 2423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.876288 (+ 2871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.877423 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.877591 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:47.886673 (+ 9082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:47.886698 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:47.886719 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:47.886774 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:47.891513 (+ 4739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:47.894377 (+ 2864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:47.894388 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:47.894392 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:47.894609 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:47.895154 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:47.895159 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:47.895162 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:47.895677 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:47.896804 (+ 1127us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:47.898192 (+ 1388us) server_negotiation.cc:299] Negotiation successful
0808 23:33:47.898508 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":841,"thread_start_us":1064,"threads_started":1}
I20260808 23:33:47.901014 1978 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:47.904211 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:47.863049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:44651 (local address 127.26.207.254:40267)
0808 23:33:47.866068 (+ 3019us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:47.866073 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:47.866095 (+ 22us) server_negotiation.cc:407] Connection header received
0808 23:33:47.870737 (+ 4642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:47.870744 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:47.870860 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:47.870978 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:47.878041 (+ 7063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.879368 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.883199 (+ 3831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.884094 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.884220 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:47.894713 (+ 10493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:47.894723 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:47.894746 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:47.894794 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:47.898989 (+ 4195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:47.900691 (+ 1702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:47.900699 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:47.900705 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:47.900928 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:47.901473 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:47.901482 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:47.901488 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:47.902035 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:47.902265 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:47.903435 (+ 1170us) server_negotiation.cc:299] Negotiation successful
0808 23:33:47.903791 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2899,"thread_start_us":2792,"threads_started":1}
I20260808 23:33:47.905686 2684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:47.864060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.194:44651)
0808 23:33:47.865331 (+ 1271us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:47.865394 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:47.869373 (+ 3979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:47.873340 (+ 3967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:47.873359 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:47.876090 (+ 2731us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:47.877770 (+ 1680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:47.877805 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.879683 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.879689 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:47.882987 (+ 3298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:47.883008 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.884653 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.884661 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:47.886606 (+ 1945us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:47.887782 (+ 1176us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:47.887806 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:47.894339 (+ 6533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:47.900021 (+ 5682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:47.900026 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:47.900028 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:47.900520 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:47.901073 (+ 553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:47.901077 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:47.901081 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:47.901340 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:47.902234 (+ 894us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:47.902246 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:47.902895 (+ 649us) client_negotiation.cc:769] Sending connection context
0808 23:33:47.903267 (+ 372us) client_negotiation.cc:240] Negotiation successful
0808 23:33:47.903991 (+ 724us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":886,"mutex_wait_us":1417,"spinlock_wait_cycles":2432,"thread_start_us":1336,"threads_started":1}
I20260808 23:33:47.905772 2685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:47.864897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:38323 (local address 127.26.207.252:36471)
0808 23:33:47.868768 (+ 3871us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:47.868791 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:47.874536 (+ 5745us) server_negotiation.cc:407] Connection header received
0808 23:33:47.877742 (+ 3206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:47.877751 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:47.877883 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:47.877992 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:47.880143 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.881842 (+ 1699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.885321 (+ 3479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.885878 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.885988 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:47.894296 (+ 8308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:47.894305 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:47.894311 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:47.894385 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:47.898869 (+ 4484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:47.900032 (+ 1163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:47.900039 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:47.900042 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:47.900209 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:47.900808 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:47.900815 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:47.900818 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:47.901233 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:47.901403 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:47.905044 (+ 3641us) server_negotiation.cc:299] Negotiation successful
0808 23:33:47.905342 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3659,"thread_start_us":3550,"threads_started":1}
I20260808 23:33:47.906896 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:47.864060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36471 (local address 127.26.207.194:38323)
0808 23:33:47.874390 (+ 10330us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:47.874420 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:47.874744 (+ 324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:47.878356 (+ 3612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:47.878364 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:47.879399 (+ 1035us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:47.879872 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:47.879892 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.882582 (+ 2690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.882591 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:47.885088 (+ 2497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:47.885112 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.886377 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.886385 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:47.886596 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:47.887609 (+ 1013us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:47.887642 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:47.893846 (+ 6204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:47.899080 (+ 5234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:47.899092 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:47.899117 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:47.899834 (+ 717us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:47.900358 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:47.900363 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:47.900368 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:47.900634 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:47.902321 (+ 1687us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:47.902329 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:47.902895 (+ 566us) client_negotiation.cc:769] Sending connection context
0808 23:33:47.906049 (+ 3154us) client_negotiation.cc:240] Negotiation successful
0808 23:33:47.906382 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6000,"mutex_wait_us":993,"spinlock_wait_cycles":63360,"thread_start_us":4799,"threads_started":1}
I20260808 23:33:47.907406 2678 heartbeater.cc:347] Connected to a master server at 127.26.207.254:40267
I20260808 23:33:47.907747 2678 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:47.907950 2677 heartbeater.cc:347] Connected to a master server at 127.26.207.252:36471
I20260808 23:33:47.908113 2677 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:47.909085 2678 heartbeater.cc:511] Master 127.26.207.254:40267 requested a full tablet report, sending...
I20260808 23:33:47.909086 2677 heartbeater.cc:511] Master 127.26.207.252:36471 requested a full tablet report, sending...
I20260808 23:33:47.911116 1501 ts_manager.cc:194] Re-registered known tserver with Master: a7837de2d37f47c3b0f92d89fe52b99a (127.26.207.194:36475)
I20260808 23:33:47.911134 2336 ts_manager.cc:194] Registered new tserver with Master: a7837de2d37f47c3b0f92d89fe52b99a (127.26.207.194:36475)
I20260808 23:33:47.911453 2687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:47.871017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:52091 (local address 127.26.207.253:46827)
0808 23:33:47.874336 (+ 3319us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:47.874342 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:47.885881 (+ 11539us) server_negotiation.cc:407] Connection header received
0808 23:33:47.886167 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:47.886173 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:47.886266 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:47.886382 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:47.888738 (+ 2356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.890157 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.891622 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.892333 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.892498 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:47.897870 (+ 5372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:47.897878 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:47.897883 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:47.897932 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:47.905063 (+ 7131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:47.906036 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:47.906042 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:47.906046 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:47.906228 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:47.906674 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:47.906682 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:47.906686 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:47.908884 (+ 2198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:47.909060 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:47.910658 (+ 1598us) server_negotiation.cc:299] Negotiation successful
0808 23:33:47.910956 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3188,"thread_start_us":3051,"threads_started":1}
I20260808 23:33:47.911934 2688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:47.874973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:46827 (local address 127.26.207.194:52091)
0808 23:33:47.885714 (+ 10741us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:47.885737 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:47.885992 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:47.886585 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:47.886591 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:47.887518 (+ 927us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:47.888516 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:47.888532 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.890330 (+ 1798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.890334 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:47.891469 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:47.891480 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:47.892960 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:47.892968 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:47.893195 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:47.893838 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:47.893867 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:47.897586 (+ 3719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:47.905247 (+ 7661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:47.905253 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:47.905257 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:47.905841 (+ 584us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:47.906370 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:47.906375 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:47.906378 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:47.906557 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:47.909137 (+ 2580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:47.909144 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:47.909332 (+ 188us) client_negotiation.cc:769] Sending connection context
0808 23:33:47.909565 (+ 233us) client_negotiation.cc:240] Negotiation successful
0808 23:33:47.909918 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10516,"thread_start_us":10253,"threads_started":1}
I20260808 23:33:47.912339 1501 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:44651
I20260808 23:33:47.912792 2679 heartbeater.cc:347] Connected to a master server at 127.26.207.253:46827
I20260808 23:33:47.912947 2679 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:47.913453 2679 heartbeater.cc:511] Master 127.26.207.253:46827 requested a full tablet report, sending...
I20260808 23:33:47.914569 2135 ts_manager.cc:194] Registered new tserver with Master: a7837de2d37f47c3b0f92d89fe52b99a (127.26.207.194:36475)
I20260808 23:33:47.991979 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 1850
I20260808 23:33:48.013242 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:39753
--local_ip_for_outbound_sockets=127.26.207.195
--tserver_master_addrs=127.26.207.254:40267
--webserver_port=38701
--webserver_interface=127.26.207.195
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.195.keytab
--principal=oryx/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.207.254:40267,127.26.207.253:46827
--tserver_master_addrs=127.26.207.254:40267,127.26.207.253:46827,127.26.207.252:36471 with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:33:48.252638 2522 heartbeater.cc:503] Master 127.26.207.254:40267 was elected leader, sending a full tablet report...
W20260808 23:33:48.380486 2690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:48.380892 2690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:48.381101 2690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:48.389168 2690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:48.389367 2690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:48.389562 2690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:33:48.400379 2690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.195.keytab
--principal=oryx/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:39753
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=38701
--tserver_master_addrs=127.26.207.254:40267,127.26.207.253:46827,127.26.207.252:36471
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:48.402387 2690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:48.403846 2690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:48.419742 2695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:48.420106 2696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:48.420317 2698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:48.421844 2690 server_base.cc:1034] running on GCE node
I20260808 23:33:48.422585 2690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:48.423693 2690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:48.424902 2690 hybrid_clock.cc:648] HybridClock initialized: now 1786232028424843 us; error 56 us; skew 500 ppm
I20260808 23:33:48.425285 2690 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:48 dist-test-slave-1x4g krb5kdc[1454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232028, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:48.428718 2690 init.cc:377] Logged in from keytab as oryx/127.26.207.195@KRBTEST.COM (short username oryx)
I20260808 23:33:48.430335 2690 webserver.cc:460] Webserver started at http://127.26.207.195:38701/ using document root <none> and password file <none>
I20260808 23:33:48.431033 2690 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:48.431162 2690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:48.436944 2690 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:33:48.440014 2706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:48.441606 2690 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:33:48.441764 2690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "6a46660e47fd4c6c8561cee666054b1e"
format_stamp: "Formatted at 2026-08-08 23:33:44 on dist-test-slave-1x4g"
server_key: "22ac68f0125bf9aea98410d2cbccd281"
server_key_iv: "cee996c68b48a775d9440e029061b6a4"
server_key_version: "encryptionkey@0"
I20260808 23:33:48.442826 2690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:48.480607 2690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:48.485468 2690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:48.485737 2690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:48.486770 2690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:33:48.488215 2690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:48.488307 2690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:48.488397 2690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:48.488456 2690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:48.525779 2690 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:39753
I20260808 23:33:48.525877 2825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:39753 every 8 connection(s)
I20260808 23:33:48.527393 2690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:33:48.532874 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 2690
Aug 08 23:33:48 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232028, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.252@KRBTEST.COM
Aug 08 23:33:48 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232028, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM
I20260808 23:33:48.574720 2836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:48.539127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36471 (local address 127.26.207.195:50317)
0808 23:33:48.545381 (+ 6254us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:48.545412 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:48.545628 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:48.546869 (+ 1241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:48.546883 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:48.548424 (+ 1541us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:48.549957 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:48.549988 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.551620 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.551626 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:48.554894 (+ 3268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:48.554918 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.556731 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.556741 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:48.557186 (+ 445us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:48.558186 (+ 1000us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:48.558234 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:48.562246 (+ 4012us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:48.567757 (+ 5511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:48.567775 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:48.567805 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:48.568824 (+ 1019us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:48.569601 (+ 777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:48.569610 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:48.569616 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:48.569995 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:48.570993 (+ 998us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:48.571002 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:48.571544 (+ 542us) client_negotiation.cc:769] Sending connection context
0808 23:33:48.571903 (+ 359us) client_negotiation.cc:240] Negotiation successful
0808 23:33:48.572516 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6073,"mutex_wait_us":40,"thread_start_us":5844,"threads_started":1}
I20260808 23:33:48.576632 2831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:48.530577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:50317 (local address 127.26.207.252:36471)
0808 23:33:48.541525 (+ 10948us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:48.541534 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:48.545557 (+ 4023us) server_negotiation.cc:407] Connection header received
0808 23:33:48.546020 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:48.546027 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:48.546132 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:48.546261 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:48.550234 (+ 3973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.551385 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.555148 (+ 3763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.556117 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.556249 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:48.562639 (+ 6390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:48.562649 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:48.562656 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:48.562729 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:48.567528 (+ 4799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:48.569096 (+ 1568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:48.569104 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:48.569111 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:48.569400 (+ 289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:48.570177 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:48.570186 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:48.570192 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:48.570741 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:48.570901 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:48.575639 (+ 4738us) server_negotiation.cc:299] Negotiation successful
0808 23:33:48.576048 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10767,"thread_start_us":11539,"threads_started":1}
Aug 08 23:33:48 dist-test-slave-1x4g krb5kdc[1454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232028, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.253@KRBTEST.COM
I20260808 23:33:48.589186 2835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:48.539555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.195:40487)
0808 23:33:48.547323 (+ 7768us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:48.547352 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:48.547674 (+ 322us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:48.548377 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:48.548394 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:48.549027 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:48.549953 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:48.549982 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.551959 (+ 1977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.551965 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:48.554595 (+ 2630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:48.554622 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.560990 (+ 6368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.561001 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:48.561329 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:48.564016 (+ 2687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:48.564050 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:48.574238 (+ 10188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:48.581043 (+ 6805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:48.581054 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:48.581059 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:48.581799 (+ 740us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:48.582410 (+ 611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:48.582415 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:48.582418 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:48.582615 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:48.587598 (+ 4983us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:48.587606 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:48.587847 (+ 241us) client_negotiation.cc:769] Sending connection context
0808 23:33:48.588034 (+ 187us) client_negotiation.cc:240] Negotiation successful
0808 23:33:48.588504 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7612,"mutex_wait_us":114,"thread_start_us":3433,"threads_started":1}
I20260808 23:33:48.590875 2826 heartbeater.cc:347] Connected to a master server at 127.26.207.252:36471
I20260808 23:33:48.591372 2826 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:48.592505 2826 heartbeater.cc:511] Master 127.26.207.252:36471 requested a full tablet report, sending...
I20260808 23:33:48.594372 2833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:48.530601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:40487 (local address 127.26.207.254:40267)
0808 23:33:48.540920 (+ 10319us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:48.540930 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:48.547589 (+ 6659us) server_negotiation.cc:407] Connection header received
0808 23:33:48.547875 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:48.547912 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:48.548027 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:48.548229 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:48.550149 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.551353 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.554794 (+ 3441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.555615 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.555756 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:48.574515 (+ 18759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:48.574525 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:48.574532 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:48.574586 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:48.579375 (+ 4789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:48.581939 (+ 2564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:48.581945 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:48.581948 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:48.582223 (+ 275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:48.583715 (+ 1492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:48.583722 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:48.583725 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:48.584509 (+ 784us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:48.584705 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:48.593624 (+ 8919us) server_negotiation.cc:299] Negotiation successful
0808 23:33:48.593885 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10103,"thread_start_us":10327,"threads_started":1}
I20260808 23:33:48.594916 2336 ts_manager.cc:194] Registered new tserver with Master: 6a46660e47fd4c6c8561cee666054b1e (127.26.207.195:39753)
I20260808 23:33:48.596997 2827 heartbeater.cc:347] Connected to a master server at 127.26.207.254:40267
I20260808 23:33:48.597172 2827 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:48.597721 2827 heartbeater.cc:511] Master 127.26.207.254:40267 requested a full tablet report, sending...
I20260808 23:33:48.598898 1501 ts_manager.cc:194] Re-registered known tserver with Master: 6a46660e47fd4c6c8561cee666054b1e (127.26.207.195:39753)
I20260808 23:33:48.600102 1501 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:40487
I20260808 23:33:48.601927 2832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:48.530577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:48781 (local address 127.26.207.253:46827)
0808 23:33:48.542048 (+ 11471us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:48.542057 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:48.543555 (+ 1498us) server_negotiation.cc:407] Connection header received
0808 23:33:48.546169 (+ 2614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:48.546178 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:48.546271 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:48.546482 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:48.550845 (+ 4363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.551796 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.581484 (+ 29688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.582739 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.582886 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:48.592506 (+ 9620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:48.592513 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:48.592521 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:48.592574 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:48.597463 (+ 4889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:48.598674 (+ 1211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:48.598683 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:48.598689 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:48.598906 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:48.599505 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:48.599514 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:48.599520 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:48.599999 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:48.600175 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:48.600972 (+ 797us) server_negotiation.cc:299] Negotiation successful
0808 23:33:48.601319 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11278,"thread_start_us":11111,"threads_started":1}
I20260808 23:33:48.602062 2841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:48.552361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53934 (local address 127.26.207.254:40267)
0808 23:33:48.560792 (+ 8431us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:48.560800 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:48.571826 (+ 11026us) server_negotiation.cc:407] Connection header received
0808 23:33:48.571910 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:48.571915 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:48.572001 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:48.572152 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:48.577917 (+ 5765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.579666 (+ 1749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.581714 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.582417 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.582520 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:48.587211 (+ 4691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:48.587231 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:48.587238 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:48.587291 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:48.593269 (+ 5978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:48.596130 (+ 2861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:48.596137 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:48.596142 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:48.596328 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:48.596902 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:48.596941 (+ 39us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:48.596944 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:48.597332 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:48.597635 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:48.601360 (+ 3725us) server_negotiation.cc:299] Negotiation successful
0808 23:33:48.601674 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8238,"thread_start_us":7098,"threads_started":1}
I20260808 23:33:48.603495 2837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:48.538460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:46827 (local address 127.26.207.195:48781)
0808 23:33:48.543348 (+ 4888us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:48.543399 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:48.545617 (+ 2218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:48.546869 (+ 1252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:48.546883 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:48.549255 (+ 2372us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:48.549953 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:48.549982 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.578926 (+ 28944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.578936 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:48.581197 (+ 2261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:48.581221 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.583377 (+ 2156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.583398 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:48.583676 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:48.584667 (+ 991us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:48.584699 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:48.592194 (+ 7495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:48.597727 (+ 5533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:48.597736 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:48.597743 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:48.598478 (+ 735us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:48.599097 (+ 619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:48.599105 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:48.599112 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:48.599334 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:48.600285 (+ 951us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:48.600293 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:48.600547 (+ 254us) client_negotiation.cc:769] Sending connection context
0808 23:33:48.602265 (+ 1718us) client_negotiation.cc:240] Negotiation successful
0808 23:33:48.602842 (+ 577us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4585,"mutex_wait_us":81,"thread_start_us":8319,"threads_started":1}
I20260808 23:33:48.604879 2828 heartbeater.cc:347] Connected to a master server at 127.26.207.253:46827
I20260808 23:33:48.605129 2828 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:48.605636 2828 heartbeater.cc:511] Master 127.26.207.253:46827 requested a full tablet report, sending...
I20260808 23:33:48.606966 2135 ts_manager.cc:194] Registered new tserver with Master: 6a46660e47fd4c6c8561cee666054b1e (127.26.207.195:39753)
I20260808 23:33:48.620290 2831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:48.555792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58458 (local address 127.26.207.252:36471)
0808 23:33:48.576898 (+ 21106us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:48.576906 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:48.590036 (+ 13130us) server_negotiation.cc:407] Connection header received
0808 23:33:48.590109 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:48.590117 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:48.590235 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:48.590375 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:48.593285 (+ 2910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.595801 (+ 2516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.605598 (+ 9797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.606351 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.606508 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:48.612067 (+ 5559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:48.612074 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:48.612078 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:48.612129 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:48.616463 (+ 4334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:48.617611 (+ 1148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:48.617618 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:48.617622 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:48.617902 (+ 280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:48.618391 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:48.618399 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:48.618404 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:48.618883 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:48.619152 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:48.619576 (+ 424us) server_negotiation.cc:299] Negotiation successful
0808 23:33:48.619818 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20996,"thread_start_us":28231,"threads_started":1}
I20260808 23:33:48.610834 1501 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53934:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:33:48.622521 1501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:33:48.623813 2845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:48.557573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58150 (local address 127.26.207.253:46827)
0808 23:33:48.565371 (+ 7798us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:48.565379 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:48.602315 (+ 36936us) server_negotiation.cc:407] Connection header received
0808 23:33:48.602383 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:48.602388 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:48.602468 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:48.604412 (+ 1944us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:48.606043 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.608874 (+ 2831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.611739 (+ 2865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.612512 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.612714 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:48.616360 (+ 3646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:48.616367 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:48.616370 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:48.616408 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:48.620578 (+ 4170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:48.621346 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:48.621349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:48.621352 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:48.621574 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:48.622032 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:48.622037 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:48.622041 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:48.622351 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:48.622674 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:48.622988 (+ 314us) server_negotiation.cc:299] Negotiation successful
0808 23:33:48.623246 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6365,"thread_start_us":3180,"threads_started":1}
I20260808 23:33:48.704452 2860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:48.663502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45878 (local address 127.26.207.194:36475)
0808 23:33:48.677301 (+ 13799us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:48.677340 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:48.677396 (+ 56us) server_negotiation.cc:407] Connection header received
0808 23:33:48.677586 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:48.677629 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:48.678228 (+ 599us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:48.679258 (+ 1030us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:48.685830 (+ 6572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.688265 (+ 2435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.695895 (+ 7630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.700665 (+ 4770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.701362 (+ 697us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:48.701763 (+ 401us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:48.703206 (+ 1443us) server_negotiation.cc:299] Negotiation successful
0808 23:33:48.703759 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13427,"thread_start_us":13156,"threads_started":1}
I20260808 23:33:48.705041 2864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:48.679709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43008 (local address 127.26.207.195:39753)
0808 23:33:48.681225 (+ 1516us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:48.681288 (+ 63us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:48.681349 (+ 61us) server_negotiation.cc:407] Connection header received
0808 23:33:48.681538 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:48.681550 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:48.681969 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:48.682455 (+ 486us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:48.685831 (+ 3376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.688626 (+ 2795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.696109 (+ 7483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.699988 (+ 3879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.700314 (+ 326us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:48.700926 (+ 612us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:48.703951 (+ 3025us) server_negotiation.cc:299] Negotiation successful
0808 23:33:48.704307 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1131,"thread_start_us":1273,"threads_started":1}
I20260808 23:33:48.705076 2861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:48.666616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40336 (local address 127.26.207.193:44589)
0808 23:33:48.673335 (+ 6719us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:48.673361 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:48.673474 (+ 113us) server_negotiation.cc:407] Connection header received
0808 23:33:48.673758 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:48.673848 (+ 90us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:48.674542 (+ 694us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:48.675610 (+ 1068us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:48.677584 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.680657 (+ 3073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.693780 (+ 13123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.701075 (+ 7295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.701408 (+ 333us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:48.701780 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:48.704227 (+ 2447us) server_negotiation.cc:299] Negotiation successful
0808 23:33:48.704521 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6128,"thread_start_us":5835,"threads_started":1}
I20260808 23:33:48.706218 2862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:48.667514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:44589 (local address 127.0.0.1:40336)
0808 23:33:48.671592 (+ 4078us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:48.671676 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:48.671990 (+ 314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:48.675535 (+ 3545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:48.675553 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:48.675593 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:48.677100 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:48.677130 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.681835 (+ 4705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.681854 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:48.693406 (+ 11552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:48.693450 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.702539 (+ 9089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.702564 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:48.702903 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:48.703096 (+ 193us) client_negotiation.cc:769] Sending connection context
0808 23:33:48.703253 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 23:33:48.703742 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3768,"mutex_wait_us":658,"thread_start_us":3371,"threads_started":1}
I20260808 23:33:48.706342 2859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:48.662979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:36475 (local address 127.0.0.1:45878)
0808 23:33:48.670922 (+ 7943us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:48.671024 (+ 102us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:48.671362 (+ 338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:48.682923 (+ 11561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:48.682938 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:48.683004 (+ 66us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:48.684398 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:48.684443 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.688688 (+ 4245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.688708 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:48.695444 (+ 6736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:48.695487 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.701376 (+ 5889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.701383 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:48.702139 (+ 756us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:48.702837 (+ 698us) client_negotiation.cc:769] Sending connection context
0808 23:33:48.703013 (+ 176us) client_negotiation.cc:240] Negotiation successful
0808 23:33:48.703436 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7555,"mutex_wait_us":555,"thread_start_us":6978,"threads_started":1}
I20260808 23:33:48.706377 2863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:48.678116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:39753 (local address 127.0.0.1:43008)
0808 23:33:48.679630 (+ 1514us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:48.679650 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:48.679878 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:48.682414 (+ 2536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:48.682452 (+ 38us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:48.682500 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:48.685403 (+ 2903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:48.685421 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.689206 (+ 3785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.689227 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:48.695456 (+ 6229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:48.695486 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:48.701365 (+ 5879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:48.701375 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:48.702876 (+ 1501us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:48.703000 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 23:33:48.703164 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 23:33:48.703552 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1296,"mutex_wait_us":491,"thread_start_us":3199,"threads_started":1}
I20260808 23:33:48.714160 2757 tablet_service.cc:1467] Processing CreateTablet for tablet 6d8ede4779c1483f802d303874d35a8a (DEFAULT_TABLE table=test-table [id=f270bb3b22ca46a2a50ad0e22ddf3ab7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:48.715320 2608 tablet_service.cc:1467] Processing CreateTablet for tablet 6d8ede4779c1483f802d303874d35a8a (DEFAULT_TABLE table=test-table [id=f270bb3b22ca46a2a50ad0e22ddf3ab7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:48.717101 2757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d8ede4779c1483f802d303874d35a8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:48.718397 2608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d8ede4779c1483f802d303874d35a8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:48.717195 2454 tablet_service.cc:1467] Processing CreateTablet for tablet 6d8ede4779c1483f802d303874d35a8a (DEFAULT_TABLE table=test-table [id=f270bb3b22ca46a2a50ad0e22ddf3ab7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:48.721499 2454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d8ede4779c1483f802d303874d35a8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:48.744519 2865 tablet_bootstrap.cc:492] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a: Bootstrap starting.
I20260808 23:33:48.756175 2865 tablet_bootstrap.cc:654] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:48.756348 2866 tablet_bootstrap.cc:492] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e: Bootstrap starting.
I20260808 23:33:48.759629 2865 log.cc:824] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:48.761967 2868 tablet_bootstrap.cc:492] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2: Bootstrap starting.
I20260808 23:33:48.768932 2866 tablet_bootstrap.cc:654] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:48.771504 2865 tablet_bootstrap.cc:492] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a: No bootstrap required, opened a new log
I20260808 23:33:48.771679 2866 log.cc:824] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:48.771831 2868 tablet_bootstrap.cc:654] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:48.771974 2865 ts_tablet_manager.cc:1397] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a: Time spent bootstrapping tablet: real 0.028s user 0.016s sys 0.004s
I20260808 23:33:48.776171 2868 log.cc:824] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:48.780515 2866 tablet_bootstrap.cc:492] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e: No bootstrap required, opened a new log
I20260808 23:33:48.781240 2866 ts_tablet_manager.cc:1397] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e: Time spent bootstrapping tablet: real 0.026s user 0.022s sys 0.000s
I20260808 23:33:48.790524 2868 tablet_bootstrap.cc:492] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2: No bootstrap required, opened a new log
I20260808 23:33:48.791563 2868 ts_tablet_manager.cc:1397] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2: Time spent bootstrapping tablet: real 0.030s user 0.012s sys 0.014s
I20260808 23:33:48.797564 2865 raft_consensus.cc:348] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } }
I20260808 23:33:48.798620 2865 raft_consensus.cc:374] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:48.798884 2865 raft_consensus.cc:729] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7837de2d37f47c3b0f92d89fe52b99a, State: Initialized, Role: FOLLOWER
I20260808 23:33:48.800516 2865 consensus_queue.cc:260] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } }
I20260808 23:33:48.806633 2865 ts_tablet_manager.cc:1428] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a: Time spent starting tablet: real 0.034s user 0.023s sys 0.012s
I20260808 23:33:48.807652 2678 heartbeater.cc:503] Master 127.26.207.254:40267 was elected leader, sending a full tablet report...
I20260808 23:33:48.815335 2866 raft_consensus.cc:348] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } }
I20260808 23:33:48.816903 2866 raft_consensus.cc:374] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:48.817293 2866 raft_consensus.cc:729] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a46660e47fd4c6c8561cee666054b1e, State: Initialized, Role: FOLLOWER
I20260808 23:33:48.819257 2866 consensus_queue.cc:260] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } }
I20260808 23:33:48.841825 2866 ts_tablet_manager.cc:1428] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e: Time spent starting tablet: real 0.060s user 0.045s sys 0.012s
I20260808 23:33:48.842846 2827 heartbeater.cc:503] Master 127.26.207.254:40267 was elected leader, sending a full tablet report...
I20260808 23:33:48.854853 2868 raft_consensus.cc:348] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } }
I20260808 23:33:48.859386 2868 raft_consensus.cc:374] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:48.859817 2868 raft_consensus.cc:729] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dcaa86a10ba432e9ef9cfea12acc2d2, State: Initialized, Role: FOLLOWER
I20260808 23:33:48.862438 2868 consensus_queue.cc:260] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } }
I20260808 23:33:48.878077 2868 ts_tablet_manager.cc:1428] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2: Time spent starting tablet: real 0.086s user 0.039s sys 0.013s
W20260808 23:33:48.879087 2680 tablet.cc:2369] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:33:48.935655 2525 tablet.cc:2369] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:33:49.044220 2830 tablet.cc:2369] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:33:49.056020 2872 raft_consensus.cc:482] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:33:49.057099 2872 raft_consensus.cc:504] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } }
I20260808 23:33:49.063859 2872 leader_election.cc:288] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dcaa86a10ba432e9ef9cfea12acc2d2 (127.26.207.193:44589), 6a46660e47fd4c6c8561cee666054b1e (127.26.207.195:39753)
I20260808 23:33:49.093673 2861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:49.065111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:46833 (local address 127.26.207.193:44589)
0808 23:33:49.065905 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:49.065951 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:49.067733 (+ 1782us) server_negotiation.cc:407] Connection header received
0808 23:33:49.068918 (+ 1185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:49.068983 (+ 65us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:49.069389 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:49.069861 (+ 472us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:49.072760 (+ 2899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.076237 (+ 3477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.084628 (+ 8391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.087402 (+ 2774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.087819 (+ 417us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:49.087898 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:49.092071 (+ 4173us) server_negotiation.cc:299] Negotiation successful
0808 23:33:49.092964 (+ 893us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260808 23:33:49.093781 2875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:49.065251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:44589 (local address 127.26.207.194:46833)
0808 23:33:49.067425 (+ 2174us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:49.067464 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:49.068243 (+ 779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:49.070604 (+ 2361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:49.070627 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:49.070708 (+ 81us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:49.072159 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:49.072197 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.076768 (+ 4571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.076891 (+ 123us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:49.083974 (+ 7083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:49.084111 (+ 137us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.088420 (+ 4309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.088467 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:49.090317 (+ 1850us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:49.090687 (+ 370us) client_negotiation.cc:769] Sending connection context
0808 23:33:49.091345 (+ 658us) client_negotiation.cc:240] Negotiation successful
0808 23:33:49.092127 (+ 782us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1829,"mutex_wait_us":106,"thread_start_us":1249,"threads_started":1}
I20260808 23:33:49.095963 2876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:49.068447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:39753 (local address 127.26.207.194:47897)
0808 23:33:49.071014 (+ 2567us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:49.071057 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:49.071417 (+ 360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:49.072684 (+ 1267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:49.072758 (+ 74us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:49.072901 (+ 143us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:49.074557 (+ 1656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:49.074608 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.079618 (+ 5010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.079633 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:49.086323 (+ 6690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:49.086355 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.093460 (+ 7105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.093471 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:49.094228 (+ 757us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:49.094398 (+ 170us) client_negotiation.cc:769] Sending connection context
0808 23:33:49.094694 (+ 296us) client_negotiation.cc:240] Negotiation successful
0808 23:33:49.095062 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2201,"mutex_wait_us":1,"thread_start_us":1704,"threads_started":1}
I20260808 23:33:49.096290 2864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:49.069040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:47897 (local address 127.26.207.195:39753)
0808 23:33:49.070049 (+ 1009us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:49.070089 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:49.071332 (+ 1243us) server_negotiation.cc:407] Connection header received
0808 23:33:49.071900 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:49.071942 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:49.072196 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:49.072602 (+ 406us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:49.075302 (+ 2700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.078989 (+ 3687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.086648 (+ 7659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.092598 (+ 5950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.093296 (+ 698us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:49.093562 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:49.094936 (+ 1374us) server_negotiation.cc:299] Negotiation successful
0808 23:33:49.095448 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499}
I20260808 23:33:49.097015 2475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d8ede4779c1483f802d303874d35a8a" candidate_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" is_pre_election: true
I20260808 23:33:49.098574 2475 raft_consensus.cc:2454] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7837de2d37f47c3b0f92d89fe52b99a in term 0.
I20260808 23:33:49.098783 2778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d8ede4779c1483f802d303874d35a8a" candidate_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a46660e47fd4c6c8561cee666054b1e" is_pre_election: true
I20260808 23:33:49.100178 2778 raft_consensus.cc:2454] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7837de2d37f47c3b0f92d89fe52b99a in term 0.
I20260808 23:33:49.100337 2560 leader_election.cc:302] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dcaa86a10ba432e9ef9cfea12acc2d2, a7837de2d37f47c3b0f92d89fe52b99a; no voters:
I20260808 23:33:49.101447 2872 raft_consensus.cc:2781] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:33:49.101799 2872 raft_consensus.cc:482] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:33:49.102036 2872 raft_consensus.cc:3037] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:49.108096 2872 raft_consensus.cc:504] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } }
I20260808 23:33:49.110263 2872 leader_election.cc:288] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [CANDIDATE]: Term 1 election: Requested vote from peers 3dcaa86a10ba432e9ef9cfea12acc2d2 (127.26.207.193:44589), 6a46660e47fd4c6c8561cee666054b1e (127.26.207.195:39753)
I20260808 23:33:49.111253 2475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d8ede4779c1483f802d303874d35a8a" candidate_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2"
I20260808 23:33:49.111384 2778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d8ede4779c1483f802d303874d35a8a" candidate_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a46660e47fd4c6c8561cee666054b1e"
I20260808 23:33:49.111728 2475 raft_consensus.cc:3037] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:49.111865 2778 raft_consensus.cc:3037] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:49.117274 2778 raft_consensus.cc:2454] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7837de2d37f47c3b0f92d89fe52b99a in term 1.
I20260808 23:33:49.117511 2475 raft_consensus.cc:2454] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7837de2d37f47c3b0f92d89fe52b99a in term 1.
I20260808 23:33:49.118381 2560 leader_election.cc:302] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a46660e47fd4c6c8561cee666054b1e, a7837de2d37f47c3b0f92d89fe52b99a; no voters:
I20260808 23:33:49.119204 2872 raft_consensus.cc:2781] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:49.120716 2872 raft_consensus.cc:686] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [term 1 LEADER]: Becoming Leader. State: Replica: a7837de2d37f47c3b0f92d89fe52b99a, State: Running, Role: LEADER
I20260808 23:33:49.122577 2872 consensus_queue.cc:237] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } }
I20260808 23:33:49.137768 1500 catalog_manager.cc:5495] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7837de2d37f47c3b0f92d89fe52b99a (127.26.207.194). New cstate: current_term: 1 leader_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } health_report { overall_health: UNKNOWN } } }
I20260808 23:33:49.224182 2882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:49.212878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45894 (local address 127.26.207.194:36475)
0808 23:33:49.214427 (+ 1549us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:49.214432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:49.214481 (+ 49us) server_negotiation.cc:407] Connection header received
0808 23:33:49.214650 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:49.214653 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:49.214787 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:49.215113 (+ 326us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:49.216012 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.217964 (+ 1952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.220400 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.221268 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.221469 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:49.222364 (+ 895us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:49.223325 (+ 961us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:49.223571 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:49.223685 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 23:33:49.223796 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1255,"thread_start_us":926,"threads_started":1}
I20260808 23:33:49.241070 2778 raft_consensus.cc:1261] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e [term 1 FOLLOWER]: Refusing update from remote peer a7837de2d37f47c3b0f92d89fe52b99a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:49.241169 2475 raft_consensus.cc:1261] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 1 FOLLOWER]: Refusing update from remote peer a7837de2d37f47c3b0f92d89fe52b99a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:49.243750 2877 consensus_queue.cc:1035] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260808 23:33:49.244686 2872 consensus_queue.cc:1035] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:49.294220 2885 mvcc.cc:205] Tried to move back new op lower bound from 7316406391752507392 to 7316406391301455872. Current Snapshot: MvccSnapshot[applied={T|T < 7316406391752507392}]
I20260808 23:33:49.341609 1501 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:49.342517 1501 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:49.365679 1501 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e9362a636eb74053afc1aa98c2ec8788: Sending DeleteTablet for 3 replicas of tablet 6d8ede4779c1483f802d303874d35a8a
I20260808 23:33:49.370751 2608 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d8ede4779c1483f802d303874d35a8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:49 UTC) from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:45878
I20260808 23:33:49.375454 2757 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d8ede4779c1483f802d303874d35a8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:49 UTC) from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:43008
I20260808 23:33:49.372761 2454 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d8ede4779c1483f802d303874d35a8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:49 UTC) from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:40336
I20260808 23:33:49.382596 2892 tablet_replica.cc:330] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a: stopping tablet replica
I20260808 23:33:49.384136 2892 raft_consensus.cc:2229] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:33:49.386837 2892 raft_consensus.cc:2258] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:49.392593 2894 tablet_replica.cc:330] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2: stopping tablet replica
I20260808 23:33:49.393839 2894 raft_consensus.cc:2229] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:49.400996 2892 ts_tablet_manager.cc:1905] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:49.401723 2894 raft_consensus.cc:2258] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:49.405572 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 1467
I20260808 23:33:49.407490 2893 tablet_replica.cc:330] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e: stopping tablet replica
I20260808 23:33:49.408133 2894 ts_tablet_manager.cc:1905] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:49.408942 2893 raft_consensus.cc:2229] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:49.409480 1532 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:49.410796 2893 raft_consensus.cc:2258] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:49.418826 2893 ts_tablet_manager.cc:1905] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:49.434921 2894 ts_tablet_manager.cc:1918] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:49.435292 2894 log.cc:1196] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/6d8ede4779c1483f802d303874d35a8a
I20260808 23:33:49.436833 2894 ts_tablet_manager.cc:1939] T 6d8ede4779c1483f802d303874d35a8a P 3dcaa86a10ba432e9ef9cfea12acc2d2: Deleting consensus metadata
I20260808 23:33:49.442354 2893 ts_tablet_manager.cc:1918] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:49.443037 2893 log.cc:1196] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/6d8ede4779c1483f802d303874d35a8a
I20260808 23:33:49.445353 2893 ts_tablet_manager.cc:1939] T 6d8ede4779c1483f802d303874d35a8a P 6a46660e47fd4c6c8561cee666054b1e: Deleting consensus metadata
I20260808 23:33:49.462688 2892 ts_tablet_manager.cc:1918] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:49.463523 2892 log.cc:1196] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/6d8ede4779c1483f802d303874d35a8a
I20260808 23:33:49.465847 2892 ts_tablet_manager.cc:1939] T 6d8ede4779c1483f802d303874d35a8a P a7837de2d37f47c3b0f92d89fe52b99a: Deleting consensus metadata
I20260808 23:33:49.486656 2896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:49.384348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58166 (local address 127.26.207.253:46827)
0808 23:33:49.396550 (+ 12202us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:49.396593 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:49.396868 (+ 275us) server_negotiation.cc:407] Connection header received
0808 23:33:49.402211 (+ 5343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:49.402257 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:49.402603 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:49.402940 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:49.435861 (+ 32921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.438664 (+ 2803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.447146 (+ 8482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.449738 (+ 2592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.450202 (+ 464us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:49.465247 (+ 15045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:49.465303 (+ 56us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:49.465318 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:49.465489 (+ 171us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:49.477486 (+ 11997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:49.479790 (+ 2304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:49.479797 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:49.479799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:49.480135 (+ 336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:49.481852 (+ 1717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:49.481858 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:49.481860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:49.482892 (+ 1032us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:49.483576 (+ 684us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:49.484473 (+ 897us) server_negotiation.cc:299] Negotiation successful
0808 23:33:49.485256 (+ 783us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11492,"thread_start_us":12545,"threads_started":1}
I20260808 23:33:49.523785 2897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:49.393073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58470 (local address 127.26.207.252:36471)
0808 23:33:49.405791 (+ 12718us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:49.405803 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:49.487142 (+ 81339us) server_negotiation.cc:407] Connection header received
0808 23:33:49.487950 (+ 808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:49.487970 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:49.488192 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:49.488441 (+ 249us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:49.493238 (+ 4797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.495909 (+ 2671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.498826 (+ 2917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.500469 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.500931 (+ 462us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:49.506645 (+ 5714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:49.506655 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:49.506659 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:49.506760 (+ 101us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:49.514213 (+ 7453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:49.516485 (+ 2272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:49.516521 (+ 36us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:49.516551 (+ 30us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:49.517200 (+ 649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:49.518494 (+ 1294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:49.518515 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:49.518531 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:49.519564 (+ 1033us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:49.520524 (+ 960us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:49.521326 (+ 802us) server_negotiation.cc:299] Negotiation successful
0808 23:33:49.522088 (+ 762us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12356,"thread_start_us":12747,"threads_started":1}
I20260808 23:33:49.734112 1484 catalog_manager.cc:4841] TS 6a46660e47fd4c6c8561cee666054b1e (127.26.207.195:39753): tablet 6d8ede4779c1483f802d303874d35a8a (table test-table [id=f270bb3b22ca46a2a50ad0e22ddf3ab7]) successfully deleted
I20260808 23:33:49.734402 1486 catalog_manager.cc:4841] TS a7837de2d37f47c3b0f92d89fe52b99a (127.26.207.194:36475): tablet 6d8ede4779c1483f802d303874d35a8a (table test-table [id=f270bb3b22ca46a2a50ad0e22ddf3ab7]) successfully deleted
I20260808 23:33:49.734853 1484 catalog_manager.cc:4841] TS 3dcaa86a10ba432e9ef9cfea12acc2d2 (127.26.207.193:44589): tablet 6d8ede4779c1483f802d303874d35a8a (table test-table [id=f270bb3b22ca46a2a50ad0e22ddf3ab7]) successfully deleted
I20260808 23:33:49.735378 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 1467
I20260808 23:33:49.847522 2896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:49.791622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45110 (local address 127.26.207.253:46827)
0808 23:33:49.792098 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:49.792108 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:49.802375 (+ 10267us) server_negotiation.cc:407] Connection header received
0808 23:33:49.802815 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:49.802848 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:49.803043 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:49.803292 (+ 249us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:49.809215 (+ 5923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.811465 (+ 2250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.815139 (+ 3674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.816654 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.816949 (+ 295us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:49.827771 (+ 10822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:49.827781 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:49.827801 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:49.827899 (+ 98us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:49.837338 (+ 9439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:49.839909 (+ 2571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:49.839928 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:49.839931 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:49.840409 (+ 478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:49.841689 (+ 1280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:49.841709 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:49.841712 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:49.842647 (+ 935us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:49.843180 (+ 533us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:49.845745 (+ 2565us) server_negotiation.cc:299] Negotiation successful
0808 23:33:49.846370 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260808 23:33:49.850210 2897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:49.791762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35182 (local address 127.26.207.252:36471)
0808 23:33:49.792438 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:49.792445 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:49.804747 (+ 12302us) server_negotiation.cc:407] Connection header received
0808 23:33:49.805565 (+ 818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:49.805583 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:49.805843 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:49.806033 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:49.810005 (+ 3972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.811101 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.814997 (+ 3896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:49.816573 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:49.816949 (+ 376us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:49.827367 (+ 10418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:49.827393 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:49.827407 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:49.827530 (+ 123us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:49.840899 (+ 13369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:49.843041 (+ 2142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:49.843049 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:49.843053 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:49.843342 (+ 289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:49.844407 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:49.844424 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:49.844427 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:49.845295 (+ 868us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:49.845878 (+ 583us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:49.848818 (+ 2940us) server_negotiation.cc:299] Negotiation successful
0808 23:33:49.849454 (+ 636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398}
I20260808 23:33:50.306648 2907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.304402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.195:44719)
0808 23:33:50.306141 (+ 1739us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:50.306372 (+ 231us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1572,"thread_start_us":1562,"threads_started":1}
W20260808 23:33:50.308236 2827 heartbeater.cc:644] Failed to heartbeat to 127.26.207.254:40267 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
I20260808 23:33:50.312193 2908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.310273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.194:51521)
0808 23:33:50.311364 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:50.311729 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":891,"thread_start_us":563,"threads_started":1}
W20260808 23:33:50.313143 2678 heartbeater.cc:644] Failed to heartbeat to 127.26.207.254:40267 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
I20260808 23:33:50.324932 2909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.323077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.193:38939)
0808 23:33:50.324315 (+ 1238us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:50.324540 (+ 225us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1047,"thread_start_us":762,"threads_started":1}
W20260808 23:33:50.325691 2522 heartbeater.cc:644] Failed to heartbeat to 127.26.207.254:40267 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
I20260808 23:33:50.864190 2910 raft_consensus.cc:482] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9362a636eb74053afc1aa98c2ec8788)
I20260808 23:33:50.864542 2910 raft_consensus.cc:504] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } }
I20260808 23:33:50.866201 2910 leader_election.cc:288] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9362a636eb74053afc1aa98c2ec8788 (127.26.207.254:40267), fed0120785684cec9aa6afa46f6058b7 (127.26.207.253:46827)
I20260808 23:33:50.866858 2911 raft_consensus.cc:482] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9362a636eb74053afc1aa98c2ec8788)
I20260808 23:33:50.867239 2911 raft_consensus.cc:504] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } }
I20260808 23:33:50.868009 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.866537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:52698)
0808 23:33:50.867122 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:50.867692 (+ 570us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":265,"threads_started":1}
W20260808 23:33:50.868398 2323 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
I20260808 23:33:50.869338 2911 leader_election.cc:288] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9362a636eb74053afc1aa98c2ec8788 (127.26.207.254:40267), c73ba41125ef45d09943840f0dd199c2 (127.26.207.252:36471)
I20260808 23:33:50.871591 2914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.870787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:52704)
0808 23:33:50.871065 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:50.871306 (+ 241us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
W20260808 23:33:50.872007 2323 leader_election.cc:334] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e9362a636eb74053afc1aa98c2ec8788 (127.26.207.254:40267): Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
I20260808 23:33:50.874825 2918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.871601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:52720)
0808 23:33:50.874104 (+ 2503us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:50.874419 (+ 315us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2357,"thread_start_us":2196,"threads_started":1}
W20260808 23:33:50.875229 2122 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
I20260808 23:33:50.877233 2918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.876766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:52732)
0808 23:33:50.876979 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:50.877083 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 23:33:50.877574 2122 leader_election.cc:334] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e9362a636eb74053afc1aa98c2ec8788 (127.26.207.254:40267): Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
I20260808 23:33:50.879530 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.867247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:46827 (local address 127.0.0.1:45112)
0808 23:33:50.869844 (+ 2597us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:50.869872 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:50.870042 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:50.872035 (+ 1993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:50.872045 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:50.872089 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:50.872480 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:50.872495 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:50.874869 (+ 2374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:50.874875 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:50.877285 (+ 2410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:50.877303 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:50.878688 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:50.878695 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:50.878886 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:50.878926 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 23:33:50.879068 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 23:33:50.879246 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2475,"thread_start_us":3100,"threads_started":1}
I20260808 23:33:50.879930 2913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.866527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45112 (local address 127.26.207.253:46827)
0808 23:33:50.871568 (+ 5041us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:50.871574 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:50.871594 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:33:50.871673 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:50.871682 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:50.871787 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:50.872682 (+ 895us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:50.873053 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:50.874683 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:50.877490 (+ 2807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:50.878479 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:50.878619 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:50.878674 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:50.879148 (+ 474us) server_negotiation.cc:299] Negotiation successful
0808 23:33:50.879312 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4906,"thread_start_us":4692,"threads_started":1}
I20260808 23:33:50.880671 2147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c73ba41125ef45d09943840f0dd199c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "fed0120785684cec9aa6afa46f6058b7" is_pre_election: true
I20260808 23:33:50.881206 2147 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c73ba41125ef45d09943840f0dd199c2 in term 1.
I20260808 23:33:50.881902 2916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.869723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36471 (local address 127.0.0.1:35184)
0808 23:33:50.872962 (+ 3239us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:50.872994 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:50.873180 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:50.874165 (+ 985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:50.874171 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:50.874200 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:50.874759 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:50.874774 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:50.877022 (+ 2248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:50.877027 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:50.879189 (+ 2162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:50.879208 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:50.880921 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:50.880928 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:50.881170 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:50.881199 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 23:33:50.881307 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 23:33:50.881465 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3028,"mutex_wait_us":127,"thread_start_us":2884,"threads_started":1}
I20260808 23:33:50.881868 2917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.870229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35184 (local address 127.26.207.252:36471)
0808 23:33:50.873802 (+ 3573us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:50.873809 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:50.873835 (+ 26us) server_negotiation.cc:407] Connection header received
0808 23:33:50.873905 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:50.873911 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:50.873991 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:50.874115 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:50.875082 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:50.876725 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:50.879396 (+ 2671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:50.880662 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:50.880911 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:50.880986 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:50.881347 (+ 361us) server_negotiation.cc:299] Negotiation successful
0808 23:33:50.881487 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3427,"thread_start_us":3297,"threads_started":1}
I20260808 23:33:50.881860 2319 leader_election.cc:302] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c73ba41125ef45d09943840f0dd199c2, fed0120785684cec9aa6afa46f6058b7; no voters: e9362a636eb74053afc1aa98c2ec8788
I20260808 23:33:50.882351 2910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 23:33:50.882580 2910 raft_consensus.cc:482] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9362a636eb74053afc1aa98c2ec8788)
I20260808 23:33:50.882727 2910 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 1 FOLLOWER]: Advancing to term 2
I20260808 23:33:50.882941 2347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fed0120785684cec9aa6afa46f6058b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c73ba41125ef45d09943840f0dd199c2" is_pre_election: true
I20260808 23:33:50.885533 2910 raft_consensus.cc:504] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } }
I20260808 23:33:50.886036 2347 raft_consensus.cc:2379] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fed0120785684cec9aa6afa46f6058b7 in current term 2: Already voted for candidate c73ba41125ef45d09943840f0dd199c2 in this term.
I20260808 23:33:50.886483 2910 leader_election.cc:288] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [CANDIDATE]: Term 2 election: Requested vote from peers e9362a636eb74053afc1aa98c2ec8788 (127.26.207.254:40267), fed0120785684cec9aa6afa46f6058b7 (127.26.207.253:46827)
I20260808 23:33:50.887228 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.886611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:52734)
0808 23:33:50.886906 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:50.887008 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179}
I20260808 23:33:50.887215 2147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c73ba41125ef45d09943840f0dd199c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "fed0120785684cec9aa6afa46f6058b7"
I20260808 23:33:50.887463 2121 leader_election.cc:302] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fed0120785684cec9aa6afa46f6058b7; no voters: c73ba41125ef45d09943840f0dd199c2, e9362a636eb74053afc1aa98c2ec8788
I20260808 23:33:50.887545 2147 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 1 FOLLOWER]: Advancing to term 2
I20260808 23:33:50.888387 2914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.887965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:52746)
0808 23:33:50.888136 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:50.888236 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 23:33:50.888610 2323 leader_election.cc:334] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e9362a636eb74053afc1aa98c2ec8788 (127.26.207.254:40267): Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
I20260808 23:33:50.890211 2147 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73ba41125ef45d09943840f0dd199c2 in term 2.
I20260808 23:33:50.890421 2911 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 23:33:50.890762 2319 leader_election.cc:302] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c73ba41125ef45d09943840f0dd199c2, fed0120785684cec9aa6afa46f6058b7; no voters: e9362a636eb74053afc1aa98c2ec8788
I20260808 23:33:50.891088 2910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 23:33:50.891590 2910 raft_consensus.cc:686] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [term 2 LEADER]: Becoming Leader. State: Replica: c73ba41125ef45d09943840f0dd199c2, State: Running, Role: LEADER
I20260808 23:33:50.892084 2910 consensus_queue.cc:237] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } }
I20260808 23:33:50.894491 2922 sys_catalog.cc:455] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c73ba41125ef45d09943840f0dd199c2. Latest consensus state: current_term: 2 leader_uuid: "c73ba41125ef45d09943840f0dd199c2" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } } }
I20260808 23:33:50.894883 2922 sys_catalog.cc:458] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:50.895690 2924 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:33:50.901227 2924 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:33:50.902251 2924 catalog_manager.cc:1259] Loaded cluster ID: 734291609f0d48a19740bd2b3f1e023f
I20260808 23:33:50.902384 2924 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:33:50.903684 2924 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:33:50.904562 2924 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: Loaded TSK: 0
I20260808 23:33:50.905737 2924 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:33:50.952626 2336 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35182:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:33:50.960096 2336 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:33:50.964826 2914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.964310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:52766)
0808 23:33:50.964496 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:50.964606 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 23:33:50.964962 2147 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [term 2 FOLLOWER]: Refusing update from remote peer c73ba41125ef45d09943840f0dd199c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 23:33:50.965981 2914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.965569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:52780)
0808 23:33:50.965741 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:50.965836 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 23:33:50.965991 2922 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260808 23:33:50.966445 2323 consensus_peers.cc:487] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 -> Peer e9362a636eb74053afc1aa98c2ec8788 (127.26.207.254:40267): Couldn't send request to peer e9362a636eb74053afc1aa98c2ec8788. Status: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 23:33:50.970088 2911 sys_catalog.cc:455] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c73ba41125ef45d09943840f0dd199c2. Latest consensus state: current_term: 2 leader_uuid: "c73ba41125ef45d09943840f0dd199c2" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } } }
I20260808 23:33:50.970417 2911 sys_catalog.cc:458] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:33:50.972143 2922 sys_catalog.cc:455] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "c73ba41125ef45d09943840f0dd199c2" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } } }
I20260808 23:33:50.972488 2922 sys_catalog.cc:458] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2 [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:50.973060 2911 sys_catalog.cc:455] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "c73ba41125ef45d09943840f0dd199c2" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e9362a636eb74053afc1aa98c2ec8788" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40267 } } peers { permanent_uuid: "fed0120785684cec9aa6afa46f6058b7" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 46827 } attrs { promote: false } } peers { permanent_uuid: "c73ba41125ef45d09943840f0dd199c2" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36471 } attrs { promote: false } } }
I20260808 23:33:50.973405 2911 sys_catalog.cc:458] T 00000000000000000000000000000000 P fed0120785684cec9aa6afa46f6058b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:33:50.992412 2914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.981892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:39753 (local address 127.0.0.1:33068)
0808 23:33:50.982031 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:50.982053 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:50.982231 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:50.982896 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:50.982901 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:50.982930 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:50.983408 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:50.983424 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:50.985182 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:50.985191 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:50.988672 (+ 3481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:50.988699 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:50.991210 (+ 2511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:50.991220 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:50.991512 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:50.991571 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 23:33:50.991671 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 23:33:50.991895 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 23:33:50.994298 2930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.982009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33068 (local address 127.26.207.195:39753)
0808 23:33:50.982561 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:50.982567 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:50.982588 (+ 21us) server_negotiation.cc:407] Connection header received
0808 23:33:50.982662 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:50.982667 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:50.982754 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:50.982861 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:50.983564 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:50.984966 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:50.989034 (+ 4068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:50.990852 (+ 1818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:50.992359 (+ 1507us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:50.992490 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:50.992563 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 23:33:50.993000 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":288,"threads_started":1}
I20260808 23:33:50.995239 2757 tablet_service.cc:1467] Processing CreateTablet for tablet 84d02e67f19745d99c23c7a5ee8d5433 (DEFAULT_TABLE table=test-table [id=09952eb47e2245beb25109d0b5d038c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:50.995780 2757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84d02e67f19745d99c23c7a5ee8d5433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:51.001775 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.983020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:44589 (local address 127.0.0.1:45082)
0808 23:33:50.983187 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:50.983207 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:50.983349 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:50.996553 (+ 13204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:50.996558 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:50.996588 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:50.996814 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:50.996826 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:50.998163 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:50.998169 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:50.999603 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:50.999620 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.001142 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.001148 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:51.001326 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:51.001357 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 23:33:51.001421 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 23:33:51.001537 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":27}
I20260808 23:33:51.002691 2932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.983695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45082 (local address 127.26.207.193:44589)
0808 23:33:50.996187 (+ 12492us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:50.996195 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:50.996216 (+ 21us) server_negotiation.cc:407] Connection header received
0808 23:33:50.996289 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:50.996296 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:50.996385 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:50.996502 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:50.996987 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:50.998011 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:50.999813 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.000913 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.002150 (+ 1237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:51.002233 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:51.002290 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 23:33:51.002450 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12328,"thread_start_us":12253,"threads_started":1}
I20260808 23:33:51.003772 2454 tablet_service.cc:1467] Processing CreateTablet for tablet 84d02e67f19745d99c23c7a5ee8d5433 (DEFAULT_TABLE table=test-table [id=09952eb47e2245beb25109d0b5d038c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:51.004040 2931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.983546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:36475 (local address 127.0.0.1:54126)
0808 23:33:50.986141 (+ 2595us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:50.986168 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:50.986328 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:50.995608 (+ 9280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:50.995617 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:50.995654 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:50.996028 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:50.996043 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:50.997600 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:50.997605 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:51.000550 (+ 2945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:51.000569 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.002806 (+ 2237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.002813 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:51.003031 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:51.003093 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 23:33:51.003220 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 23:33:51.003435 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2389,"mutex_wait_us":1,"thread_start_us":2137,"threads_started":1}
I20260808 23:33:51.004310 2454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84d02e67f19745d99c23c7a5ee8d5433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:51.005028 2933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:50.983945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54126 (local address 127.26.207.194:36475)
0808 23:33:50.995105 (+ 11160us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:50.995116 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:50.995144 (+ 28us) server_negotiation.cc:407] Connection header received
0808 23:33:50.995251 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:50.995260 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:50.995379 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:50.995581 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:50.996239 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:50.997444 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.000818 (+ 3374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.002339 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.002554 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:51.002632 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:51.004330 (+ 1698us) server_negotiation.cc:299] Negotiation successful
0808 23:33:51.004573 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10964,"thread_start_us":12726,"threads_started":1}
I20260808 23:33:51.006018 2608 tablet_service.cc:1467] Processing CreateTablet for tablet 84d02e67f19745d99c23c7a5ee8d5433 (DEFAULT_TABLE table=test-table [id=09952eb47e2245beb25109d0b5d038c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:51.006512 2608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84d02e67f19745d99c23c7a5ee8d5433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:51.010150 2934 tablet_bootstrap.cc:492] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e: Bootstrap starting.
I20260808 23:33:51.011915 2934 tablet_bootstrap.cc:654] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:51.012411 2935 tablet_bootstrap.cc:492] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2: Bootstrap starting.
I20260808 23:33:51.014112 2938 tablet_bootstrap.cc:492] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a: Bootstrap starting.
I20260808 23:33:51.014624 2934 tablet_bootstrap.cc:492] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e: No bootstrap required, opened a new log
I20260808 23:33:51.014704 2935 tablet_bootstrap.cc:654] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:51.014809 2934 ts_tablet_manager.cc:1397] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260808 23:33:51.015566 2934 raft_consensus.cc:348] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } }
I20260808 23:33:51.015870 2934 raft_consensus.cc:374] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:51.015973 2934 raft_consensus.cc:729] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a46660e47fd4c6c8561cee666054b1e, State: Initialized, Role: FOLLOWER
I20260808 23:33:51.016268 2938 tablet_bootstrap.cc:654] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:51.016287 2934 consensus_queue.cc:260] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } }
I20260808 23:33:51.017588 2935 tablet_bootstrap.cc:492] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2: No bootstrap required, opened a new log
I20260808 23:33:51.018913 2934 ts_tablet_manager.cc:1428] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260808 23:33:51.019536 2942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.018332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.195:35815)
0808 23:33:51.019059 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.019251 (+ 192us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":561,"threads_started":1}
I20260808 23:33:51.020370 2935 ts_tablet_manager.cc:1397] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.001s
I20260808 23:33:51.021164 2942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.020686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.195:40199)
0808 23:33:51.020922 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.021018 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
I20260808 23:33:51.021387 2935 raft_consensus.cc:348] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } }
I20260808 23:33:51.021634 2935 raft_consensus.cc:374] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:51.021730 2935 raft_consensus.cc:729] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dcaa86a10ba432e9ef9cfea12acc2d2, State: Initialized, Role: FOLLOWER
I20260808 23:33:51.022028 2938 tablet_bootstrap.cc:492] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a: No bootstrap required, opened a new log
I20260808 23:33:51.022185 2938 ts_tablet_manager.cc:1397] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260808 23:33:51.022033 2935 consensus_queue.cc:260] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } }
I20260808 23:33:51.022856 2826 heartbeater.cc:503] Master 127.26.207.252:36471 was elected leader, sending a full tablet report...
I20260808 23:33:51.023118 2935 ts_tablet_manager.cc:1428] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260808 23:33:51.023185 2938 raft_consensus.cc:348] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } }
I20260808 23:33:51.023437 2938 raft_consensus.cc:374] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:51.023546 2938 raft_consensus.cc:729] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7837de2d37f47c3b0f92d89fe52b99a, State: Initialized, Role: FOLLOWER
I20260808 23:33:51.023800 2938 consensus_queue.cc:260] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } }
I20260808 23:33:51.024732 2938 ts_tablet_manager.cc:1428] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 23:33:51.028913 2946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.025043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.194:55445)
0808 23:33:51.028006 (+ 2963us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.028247 (+ 241us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2816,"thread_start_us":2651,"threads_started":1}
I20260808 23:33:51.028919 2521 heartbeater.cc:503] Master 127.26.207.252:36471 was elected leader, sending a full tablet report...
I20260808 23:33:51.033805 2944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.023758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.193:54147)
0808 23:33:51.033377 (+ 9619us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.033550 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9485,"thread_start_us":9305,"threads_started":1}
I20260808 23:33:51.033934 2946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.029762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.194:37473)
0808 23:33:51.033709 (+ 3947us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.033794 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3859,"threads_started":1}
I20260808 23:33:51.035284 2944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.034831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.193:53813)
0808 23:33:51.035027 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.035108 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260808 23:33:51.151422 2940 raft_consensus.cc:482] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:33:51.151773 2940 raft_consensus.cc:504] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } }
I20260808 23:33:51.153594 2940 leader_election.cc:288] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dcaa86a10ba432e9ef9cfea12acc2d2 (127.26.207.193:44589), a7837de2d37f47c3b0f92d89fe52b99a (127.26.207.194:36475)
I20260808 23:33:51.161971 2932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.154226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:56663 (local address 127.26.207.193:44589)
0808 23:33:51.154493 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:51.154505 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:51.155015 (+ 510us) server_negotiation.cc:407] Connection header received
0808 23:33:51.155201 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:51.155205 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:51.155268 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:51.155336 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:51.155894 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.156953 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.159378 (+ 2425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.160680 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.160903 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:51.160989 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:51.161558 (+ 569us) server_negotiation.cc:299] Negotiation successful
0808 23:33:51.161703 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 23:33:51.162006 2933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.154100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:40493 (local address 127.26.207.194:36475)
0808 23:33:51.154551 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:51.154561 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:51.154592 (+ 31us) server_negotiation.cc:407] Connection header received
0808 23:33:51.154685 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:51.154690 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:51.154775 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:51.154898 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:51.155483 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.156582 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.159378 (+ 2796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.160680 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.161235 (+ 555us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:51.161289 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:51.161557 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 23:33:51.161703 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250}
I20260808 23:33:51.162094 2942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.153873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:36475 (local address 127.26.207.195:40493)
0808 23:33:51.154171 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.154203 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:51.154353 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:51.154950 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:51.154957 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:51.155010 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:51.155290 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:51.155299 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.156754 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.156758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:51.159154 (+ 2396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:51.159174 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.160972 (+ 1798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.160976 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:51.161287 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:51.161397 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 23:33:51.161506 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 23:33:51.161705 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":111}
I20260808 23:33:51.162139 2948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.153925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:44589 (local address 127.26.207.195:56663)
0808 23:33:51.154883 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.154904 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:51.155040 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:51.155391 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:51.155399 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:51.155428 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:51.155726 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:51.155734 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.157075 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.157082 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:51.159154 (+ 2072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:51.159174 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.160946 (+ 1772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.160959 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:51.161290 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:51.161402 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 23:33:51.161506 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 23:33:51.161705 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":825,"mutex_wait_us":149,"spinlock_wait_cycles":4480,"thread_start_us":692,"threads_started":1}
I20260808 23:33:51.163049 2475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d02e67f19745d99c23c7a5ee8d5433" candidate_uuid: "6a46660e47fd4c6c8561cee666054b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" is_pre_election: true
I20260808 23:33:51.163040 2630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d02e67f19745d99c23c7a5ee8d5433" candidate_uuid: "6a46660e47fd4c6c8561cee666054b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" is_pre_election: true
I20260808 23:33:51.163352 2475 raft_consensus.cc:2454] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a46660e47fd4c6c8561cee666054b1e in term 0.
I20260808 23:33:51.163501 2630 raft_consensus.cc:2454] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a46660e47fd4c6c8561cee666054b1e in term 0.
I20260808 23:33:51.163991 2708 leader_election.cc:302] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dcaa86a10ba432e9ef9cfea12acc2d2, 6a46660e47fd4c6c8561cee666054b1e; no voters:
I20260808 23:33:51.164528 2940 raft_consensus.cc:2781] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:33:51.164678 2940 raft_consensus.cc:482] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:33:51.164840 2940 raft_consensus.cc:3037] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:51.167306 2940 raft_consensus.cc:504] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } }
I20260808 23:33:51.167943 2940 leader_election.cc:288] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [CANDIDATE]: Term 1 election: Requested vote from peers 3dcaa86a10ba432e9ef9cfea12acc2d2 (127.26.207.193:44589), a7837de2d37f47c3b0f92d89fe52b99a (127.26.207.194:36475)
I20260808 23:33:51.168651 2630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d02e67f19745d99c23c7a5ee8d5433" candidate_uuid: "6a46660e47fd4c6c8561cee666054b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7837de2d37f47c3b0f92d89fe52b99a"
I20260808 23:33:51.168670 2475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d02e67f19745d99c23c7a5ee8d5433" candidate_uuid: "6a46660e47fd4c6c8561cee666054b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2"
I20260808 23:33:51.168907 2630 raft_consensus.cc:3037] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:51.168937 2475 raft_consensus.cc:3037] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:51.171655 2630 raft_consensus.cc:2454] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a46660e47fd4c6c8561cee666054b1e in term 1.
I20260808 23:33:51.171923 2475 raft_consensus.cc:2454] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a46660e47fd4c6c8561cee666054b1e in term 1.
I20260808 23:33:51.172405 2708 leader_election.cc:302] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dcaa86a10ba432e9ef9cfea12acc2d2, 6a46660e47fd4c6c8561cee666054b1e; no voters:
I20260808 23:33:51.172838 2940 raft_consensus.cc:2781] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:51.173465 2940 raft_consensus.cc:686] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [term 1 LEADER]: Becoming Leader. State: Replica: 6a46660e47fd4c6c8561cee666054b1e, State: Running, Role: LEADER
I20260808 23:33:51.174485 2940 consensus_queue.cc:237] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } } peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } }
I20260808 23:33:51.174758 2942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.174175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.195:52165)
0808 23:33:51.174384 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.174539 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 23:33:51.179289 2336 catalog_manager.cc:5495] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a46660e47fd4c6c8561cee666054b1e (127.26.207.195). New cstate: current_term: 1 leader_uuid: "6a46660e47fd4c6c8561cee666054b1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a46660e47fd4c6c8561cee666054b1e" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 } health_report { overall_health: UNKNOWN } } }
I20260808 23:33:51.238724 2930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.233104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33072 (local address 127.26.207.195:39753)
0808 23:33:51.233354 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:51.233360 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:51.233383 (+ 23us) server_negotiation.cc:407] Connection header received
0808 23:33:51.233644 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:51.233648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:51.233742 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:51.233903 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:51.234289 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.235007 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.236392 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.236911 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.237050 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:51.237488 (+ 438us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:51.238075 (+ 587us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:51.238257 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:51.238318 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 23:33:51.238406 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 23:33:51.243440 2475 raft_consensus.cc:1261] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 1 FOLLOWER]: Refusing update from remote peer 6a46660e47fd4c6c8561cee666054b1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:51.243767 2630 raft_consensus.cc:1261] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a [term 1 FOLLOWER]: Refusing update from remote peer 6a46660e47fd4c6c8561cee666054b1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:51.244441 2949 consensus_queue.cc:1035] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dcaa86a10ba432e9ef9cfea12acc2d2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:51.244978 2940 consensus_queue.cc:1035] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7837de2d37f47c3b0f92d89fe52b99a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:51.246915 2677 heartbeater.cc:503] Master 127.26.207.252:36471 was elected leader, sending a full tablet report...
I20260808 23:33:51.248442 2944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.247904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.193:44743)
0808 23:33:51.248138 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.248246 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260808 23:33:51.248489 2947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.247506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.194:47665)
0808 23:33:51.247870 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.248139 (+ 269us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168}
I20260808 23:33:51.253315 2953 mvcc.cc:205] Tried to move back new op lower bound from 7316406399964340224 to 7316406399695450112. Current Snapshot: MvccSnapshot[applied={T|T < 7316406399964340224}]
I20260808 23:33:51.255400 2947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.254783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.194:55889)
0808 23:33:51.255098 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.255198 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200}
I20260808 23:33:51.258249 2944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.257601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.193:44275)
0808 23:33:51.257897 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.258028 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
I20260808 23:33:51.261278 2942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.260543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.26.207.195:50829)
0808 23:33:51.260953 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.261061 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200}
I20260808 23:33:51.264081 2954 mvcc.cc:205] Tried to move back new op lower bound from 7316406399964340224 to 7316406399695450112. Current Snapshot: MvccSnapshot[applied={T|T < 7316406399964340224}]
I20260808 23:33:51.274184 2335 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:51.274636 2335 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:51.285048 2335 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c73ba41125ef45d09943840f0dd199c2: Sending DeleteTablet for 3 replicas of tablet 84d02e67f19745d99c23c7a5ee8d5433
I20260808 23:33:51.286526 2454 tablet_service.cc:1514] Processing DeleteTablet for tablet 84d02e67f19745d99c23c7a5ee8d5433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:51 UTC) from {username='oryx', principal='oryx/127.26.207.252@KRBTEST.COM'} at 127.0.0.1:45082
I20260808 23:33:51.286535 2608 tablet_service.cc:1514] Processing DeleteTablet for tablet 84d02e67f19745d99c23c7a5ee8d5433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:51 UTC) from {username='oryx', principal='oryx/127.26.207.252@KRBTEST.COM'} at 127.0.0.1:54126
I20260808 23:33:51.287055 2757 tablet_service.cc:1514] Processing DeleteTablet for tablet 84d02e67f19745d99c23c7a5ee8d5433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:51 UTC) from {username='oryx', principal='oryx/127.26.207.252@KRBTEST.COM'} at 127.0.0.1:33068
I20260808 23:33:51.287406 2963 tablet_replica.cc:330] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2: stopping tablet replica
I20260808 23:33:51.287674 2963 raft_consensus.cc:2229] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:51.287597 2607 tablet_service.cc:1514] Processing DeleteTablet for tablet 84d02e67f19745d99c23c7a5ee8d5433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:51 UTC) from {username='oryx', principal='oryx/127.26.207.252@KRBTEST.COM'} at 127.0.0.1:54126
I20260808 23:33:51.287892 2965 tablet_replica.cc:330] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e: stopping tablet replica
I20260808 23:33:51.288110 2963 raft_consensus.cc:2258] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:51.288131 2965 raft_consensus.cc:2229] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:33:51.289239 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 2314
I20260808 23:33:51.291312 2963 ts_tablet_manager.cc:1905] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:51.299582 2963 ts_tablet_manager.cc:1918] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:51.299904 2963 log.cc:1196] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/84d02e67f19745d99c23c7a5ee8d5433
I20260808 23:33:51.300565 2964 tablet_replica.cc:330] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a: stopping tablet replica
I20260808 23:33:51.300765 2963 ts_tablet_manager.cc:1939] T 84d02e67f19745d99c23c7a5ee8d5433 P 3dcaa86a10ba432e9ef9cfea12acc2d2: Deleting consensus metadata
I20260808 23:33:51.300750 2964 raft_consensus.cc:2229] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:51.298924 2965 raft_consensus.cc:2258] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:51.301201 2964 raft_consensus.cc:2258] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:51.302557 2964 ts_tablet_manager.cc:1905] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:51.302590 2965 ts_tablet_manager.cc:1905] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:51.307109 2320 catalog_manager.cc:4841] TS 3dcaa86a10ba432e9ef9cfea12acc2d2 (127.26.207.193:44589): tablet 84d02e67f19745d99c23c7a5ee8d5433 (table test-table [id=09952eb47e2245beb25109d0b5d038c2]) successfully deleted
I20260808 23:33:51.310141 2964 ts_tablet_manager.cc:1918] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:51.310318 2964 log.cc:1196] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/84d02e67f19745d99c23c7a5ee8d5433
I20260808 23:33:51.310863 2964 ts_tablet_manager.cc:1939] T 84d02e67f19745d99c23c7a5ee8d5433 P a7837de2d37f47c3b0f92d89fe52b99a: Deleting consensus metadata
I20260808 23:33:51.312253 2323 catalog_manager.cc:4841] TS a7837de2d37f47c3b0f92d89fe52b99a (127.26.207.194:36475): tablet 84d02e67f19745d99c23c7a5ee8d5433 (table test-table [id=09952eb47e2245beb25109d0b5d038c2]) successfully deleted
I20260808 23:33:51.313114 2965 ts_tablet_manager.cc:1918] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:51.313382 2965 log.cc:1196] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/84d02e67f19745d99c23c7a5ee8d5433
W20260808 23:33:51.313431 2323 catalog_manager.cc:4808] TS a7837de2d37f47c3b0f92d89fe52b99a (127.26.207.194:36475): delete failed for tablet 84d02e67f19745d99c23c7a5ee8d5433 because the tablet was not found. No further retry: Not found: Tablet not found: 84d02e67f19745d99c23c7a5ee8d5433
I20260808 23:33:51.314060 2965 ts_tablet_manager.cc:1939] T 84d02e67f19745d99c23c7a5ee8d5433 P 6a46660e47fd4c6c8561cee666054b1e: Deleting consensus metadata
I20260808 23:33:51.315550 2320 catalog_manager.cc:4841] TS 6a46660e47fd4c6c8561cee666054b1e (127.26.207.195:39753): tablet 84d02e67f19745d99c23c7a5ee8d5433 (table test-table [id=09952eb47e2245beb25109d0b5d038c2]) successfully deleted
I20260808 23:33:51.317276 2932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.290675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45092 (local address 127.26.207.193:44589)
0808 23:33:51.290869 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:51.290876 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:51.296017 (+ 5141us) server_negotiation.cc:407] Connection header received
0808 23:33:51.296347 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:51.296358 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:51.296566 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:51.296711 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:51.298962 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.300163 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.302481 (+ 2318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.303135 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.303268 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:51.308172 (+ 4904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:51.308195 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:51.308215 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:51.308265 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:51.312878 (+ 4613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:51.314178 (+ 1300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:51.314193 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:51.314199 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:51.314426 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:51.314979 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:51.314984 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:51.314988 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:51.315492 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:51.315740 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:51.316368 (+ 628us) server_negotiation.cc:299] Negotiation successful
0808 23:33:51.316836 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 23:33:51.318123 2516 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:51.420020 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 2314
I20260808 23:33:51.443972 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 2542
I20260808 23:33:51.459342 2933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.444870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54140 (local address 127.26.207.194:36475)
0808 23:33:51.445068 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:51.445075 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:51.445246 (+ 171us) server_negotiation.cc:407] Connection header received
0808 23:33:51.445475 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:51.445479 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:51.445561 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:51.445682 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:51.447202 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.447976 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.449441 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.449900 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.450048 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:51.452881 (+ 2833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:51.452900 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:51.452917 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:51.452957 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:51.456090 (+ 3133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:51.456966 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:51.456974 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:51.456977 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:51.457128 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:51.457615 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:51.457619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:51.457622 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:51.458027 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:51.458378 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:51.458711 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 23:33:51.459000 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 23:33:51.460038 2671 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:51.556936 2969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.539841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:52794)
0808 23:33:51.556504 (+ 16663us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.556670 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16515,"thread_start_us":16399,"threads_started":1}
I20260808 23:33:51.558698 2969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.558201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:52804)
0808 23:33:51.558408 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.558540 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 23:33:51.603497 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 2542
I20260808 23:33:51.633726 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 2690
I20260808 23:33:51.654873 2930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.634553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33082 (local address 127.26.207.195:39753)
0808 23:33:51.634734 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:51.634738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:51.634926 (+ 188us) server_negotiation.cc:407] Connection header received
0808 23:33:51.635118 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:51.635124 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:51.635224 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:51.635340 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:51.637531 (+ 2191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.638823 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.641116 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:51.641808 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:51.641954 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:51.645889 (+ 3935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:51.645910 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:51.645933 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:51.645986 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:51.650919 (+ 4933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:51.652064 (+ 1145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:51.652076 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:51.652079 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:51.652299 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:51.652883 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:51.652889 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:51.652893 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:51.653418 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:51.653772 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:51.654193 (+ 421us) server_negotiation.cc:299] Negotiation successful
0808 23:33:51.654457 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 23:33:51.655710 2821 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:51.793720 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 2690
I20260808 23:33:51.821964 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 1989
I20260808 23:33:51.823206 2167 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:51.935226 2969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.934726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:52818)
0808 23:33:51.934950 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.935067 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 23:33:51.936365 2969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:51.936002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40267 (local address 127.0.0.1:52822)
0808 23:33:51.936157 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:51.936237 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:40267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 23:33:51.951884 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 1989
I20260808 23:33:51.979444 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 2098
I20260808 23:33:51.980664 2367 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:52.107903 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 2098
2026-08-08T23:33:52Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (11236 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:33:52 dist-test-slave-1x4g krb5kdc[2977](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:33:52 dist-test-slave-1x4g krb5kdc[2977](info): set up 2 sockets
Aug 08 23:33:52 dist-test-slave-1x4g krb5kdc[2977](info): commencing operation
krb5kdc: starting...
W20260808 23:33:53.303354 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.002s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:33:53 dist-test-slave-1x4g krb5kdc[2977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:33:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:33:53Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.254.keytab.
Entry for principal oryx/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.254.keytab.
I20260808 23:33:53.605551 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:45653
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.254.keytab
--principal=oryx/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:36167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:45653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:53.972431 2991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:53.972857 2991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:53.972982 2991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:53.980736 2991 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:33:53.980906 2991 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 23:33:53.980949 2991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:53.981011 2991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:53.981065 2991 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:33:53.981123 2991 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:33:53.991737 2991 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:36167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:45653
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.254.keytab
--principal=oryx/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:45653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:53.993192 2991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:53.994801 2991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:54.008538 2999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:54.008558 2996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:54.008688 2997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:54.009493 2991 server_base.cc:1034] running on GCE node
I20260808 23:33:54.010430 2991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:54.012077 2991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:54.013407 2991 hybrid_clock.cc:648] HybridClock initialized: now 1786232034013346 us; error 57 us; skew 500 ppm
I20260808 23:33:54.013832 2991 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:54 dist-test-slave-1x4g krb5kdc[2977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232034, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:54.022260 2991 init.cc:377] Logged in from keytab as oryx/127.26.207.254@KRBTEST.COM (short username oryx)
I20260808 23:33:54.024204 2991 webserver.cc:460] Webserver started at http://127.26.207.254:34271/ using document root <none> and password file <none>
I20260808 23:33:54.025098 2991 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:54.025209 2991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:54.025673 2991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:54.029345 2991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "4b512c42959f4c4aad36e270598e4d7b"
format_stamp: "Formatted at 2026-08-08 23:33:54 on dist-test-slave-1x4g"
server_key: "bea9ed92a1118c5b7c339465ab1f288a"
server_key_iv: "6426a39317868f9fffd2a220718bb05f"
server_key_version: "encryptionkey@0"
I20260808 23:33:54.030419 2991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "4b512c42959f4c4aad36e270598e4d7b"
format_stamp: "Formatted at 2026-08-08 23:33:54 on dist-test-slave-1x4g"
server_key: "bea9ed92a1118c5b7c339465ab1f288a"
server_key_iv: "6426a39317868f9fffd2a220718bb05f"
server_key_version: "encryptionkey@0"
I20260808 23:33:54.036954 2991 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 23:33:54.041447 3007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:54.043272 2991 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 23:33:54.043519 2991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "4b512c42959f4c4aad36e270598e4d7b"
format_stamp: "Formatted at 2026-08-08 23:33:54 on dist-test-slave-1x4g"
server_key: "bea9ed92a1118c5b7c339465ab1f288a"
server_key_iv: "6426a39317868f9fffd2a220718bb05f"
server_key_version: "encryptionkey@0"
I20260808 23:33:54.043807 2991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:54.062856 2991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:54.068374 2991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:54.068749 2991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:54.095482 2991 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:45653
I20260808 23:33:54.095527 3071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:45653 every 8 connection(s)
I20260808 23:33:54.097278 2991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:33:54.101805 3072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:54.107530 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 2991
I20260808 23:33:54.107771 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:33:54.108574 27455 external_mini_cluster.cc:1428] Setting key 9483c7b88b3ba6715619be4f813502a0
I20260808 23:33:54.115315 3072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b: Bootstrap starting.
I20260808 23:33:54.120118 3072 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:54.121686 3072 log.cc:824] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b: Log is configured to *not* fsync() on all Append() calls
Aug 08 23:33:54 dist-test-slave-1x4g krb5kdc[2977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM
I20260808 23:33:54.125636 3072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b: No bootstrap required, opened a new log
I20260808 23:33:54.137368 3076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:54.111022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40394 (local address 127.26.207.254:45653)
0808 23:33:54.112059 (+ 1037us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:54.112073 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:54.112125 (+ 52us) server_negotiation.cc:407] Connection header received
0808 23:33:54.114211 (+ 2086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:54.114242 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:54.114717 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:54.115120 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:54.117462 (+ 2342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:54.118954 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:54.121029 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:54.121878 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:54.122145 (+ 267us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:54.127403 (+ 5258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:54.127415 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:54.127438 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:54.127519 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:54.131925 (+ 4406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:54.132897 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:54.132908 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:54.132918 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:54.133189 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:54.133617 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:54.133628 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:54.133632 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:54.134474 (+ 842us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:54.134782 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:54.135240 (+ 458us) server_negotiation.cc:299] Negotiation successful
0808 23:33:54.135809 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":745,"thread_start_us":448,"threads_started":1}
I20260808 23:33:54.137611 3072 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b512c42959f4c4aad36e270598e4d7b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45653 } }
I20260808 23:33:54.138092 3072 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:54.138216 3072 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b512c42959f4c4aad36e270598e4d7b, State: Initialized, Role: FOLLOWER
I20260808 23:33:54.138816 3072 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b512c42959f4c4aad36e270598e4d7b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45653 } }
I20260808 23:33:54.139091 3072 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:33:54.139271 3072 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:33:54.139462 3072 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:54.142175 3072 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b512c42959f4c4aad36e270598e4d7b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45653 } }
I20260808 23:33:54.142745 3072 leader_election.cc:302] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b512c42959f4c4aad36e270598e4d7b; no voters:
I20260808 23:33:54.143447 3072 leader_election.cc:288] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:33:54.143625 3078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:54.144439 3078 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [term 1 LEADER]: Becoming Leader. State: Replica: 4b512c42959f4c4aad36e270598e4d7b, State: Running, Role: LEADER
I20260808 23:33:54.145153 3078 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b512c42959f4c4aad36e270598e4d7b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45653 } }
I20260808 23:33:54.145812 3072 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:33:54.149523 3080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b512c42959f4c4aad36e270598e4d7b. Latest consensus state: current_term: 1 leader_uuid: "4b512c42959f4c4aad36e270598e4d7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b512c42959f4c4aad36e270598e4d7b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45653 } } }
I20260808 23:33:54.149976 3079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b512c42959f4c4aad36e270598e4d7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b512c42959f4c4aad36e270598e4d7b" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45653 } } }
I20260808 23:33:54.150159 3080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:54.150274 3079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b [sys.catalog]: This master's current role is: LEADER
I20260808 23:33:54.152053 3088 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:33:54.158322 3088 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:33:54.169064 3088 catalog_manager.cc:1347] Generated new cluster ID: 4ebe9b8e935d4c838f05b7b43f001423
I20260808 23:33:54.169207 3088 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:33:54.187511 3088 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:33:54.188987 3088 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:33:54.200357 3088 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b: Generated new TSK 0
I20260808 23:33:54.201817 3088 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.193.keytab.
Entry for principal oryx/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.193.keytab.
I20260808 23:33:54.281937 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:45653
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.193.keytab
--principal=oryx/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:36167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:54.666589 3101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:54.666935 3101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:54.667047 3101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:54.674985 3101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:54.675137 3101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:54.675235 3101 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 23:33:54.675328 3101 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:33:54.686020 3101 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:36167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.193.keytab
--principal=oryx/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.207.254:45653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:54.687448 3101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:54.689018 3101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:54.704413 3106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:54.704260 3107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:54.704321 3109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:54.705132 3101 server_base.cc:1034] running on GCE node
I20260808 23:33:54.705895 3101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:54.707005 3101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:54.708304 3101 hybrid_clock.cc:648] HybridClock initialized: now 1786232034708237 us; error 42 us; skew 500 ppm
I20260808 23:33:54.708662 3101 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:54 dist-test-slave-1x4g krb5kdc[2977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232034, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:54.712445 3101 init.cc:377] Logged in from keytab as oryx/127.26.207.193@KRBTEST.COM (short username oryx)
I20260808 23:33:54.714515 3101 webserver.cc:460] Webserver started at http://127.26.207.193:37575/ using document root <none> and password file <none>
I20260808 23:33:54.715381 3101 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:54.715543 3101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:54.715919 3101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:54.719332 3101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "b0fd7a69469d49b482d49c53c6a06c12"
format_stamp: "Formatted at 2026-08-08 23:33:54 on dist-test-slave-1x4g"
server_key: "9880f041de20e73bcfa728962cbfdea3"
server_key_iv: "61e183576d6aa18230fa5f43c1bfc5d1"
server_key_version: "encryptionkey@0"
I20260808 23:33:54.720290 3101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "b0fd7a69469d49b482d49c53c6a06c12"
format_stamp: "Formatted at 2026-08-08 23:33:54 on dist-test-slave-1x4g"
server_key: "9880f041de20e73bcfa728962cbfdea3"
server_key_iv: "61e183576d6aa18230fa5f43c1bfc5d1"
server_key_version: "encryptionkey@0"
I20260808 23:33:54.726357 3101 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 23:33:54.730772 3116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:54.732385 3101 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 23:33:54.732625 3101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "b0fd7a69469d49b482d49c53c6a06c12"
format_stamp: "Formatted at 2026-08-08 23:33:54 on dist-test-slave-1x4g"
server_key: "9880f041de20e73bcfa728962cbfdea3"
server_key_iv: "61e183576d6aa18230fa5f43c1bfc5d1"
server_key_version: "encryptionkey@0"
I20260808 23:33:54.732954 3101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:54.758440 3101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:54.763454 3101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:54.763808 3101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:54.767222 3101 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:54.767361 3101 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:54.767514 3101 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:54.767620 3101 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 23:33:54 dist-test-slave-1x4g krb5kdc[2977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232034, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM
I20260808 23:33:54.794802 3125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:54.767826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:43953 (local address 127.26.207.254:45653)
0808 23:33:54.768738 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:54.768743 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:54.769884 (+ 1141us) server_negotiation.cc:407] Connection header received
0808 23:33:54.772327 (+ 2443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:54.772333 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:54.772451 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:54.772589 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:54.775331 (+ 2742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:54.776514 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:54.778455 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:54.778903 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:54.779061 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:54.785161 (+ 6100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:54.785172 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:54.785177 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:54.785230 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:54.789437 (+ 4207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:54.790878 (+ 1441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:54.790886 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:54.790892 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:54.791122 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:54.791980 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:54.791988 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:54.791993 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:54.792501 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:54.792719 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:54.794047 (+ 1328us) server_negotiation.cc:299] Negotiation successful
0808 23:33:54.794353 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":797,"thread_start_us":697,"threads_started":1}
I20260808 23:33:54.796456 3126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:54.768669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:45653 (local address 127.26.207.193:43953)
0808 23:33:54.769674 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:54.769727 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:54.771969 (+ 2242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:54.772974 (+ 1005us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:54.772994 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:54.773975 (+ 981us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:54.775038 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:54.775090 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:54.776759 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:54.776764 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:54.778253 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:54.778269 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:54.779201 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:54.779210 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:54.779459 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:54.780369 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:54.780419 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:54.784658 (+ 4239us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:54.789675 (+ 5017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:54.789692 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:54.789711 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:54.790629 (+ 918us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:54.791308 (+ 679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:54.791324 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:54.791328 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:54.791776 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:54.792724 (+ 948us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:54.792741 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:54.793473 (+ 732us) client_negotiation.cc:769] Sending connection context
0808 23:33:54.793909 (+ 436us) client_negotiation.cc:240] Negotiation successful
0808 23:33:54.794638 (+ 729us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":740,"thread_start_us":456,"threads_started":1}
I20260808 23:33:54.822446 3125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:54.804238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:44013 (local address 127.26.207.254:45653)
0808 23:33:54.804519 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:54.804529 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:54.805488 (+ 959us) server_negotiation.cc:407] Connection header received
0808 23:33:54.805738 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:54.805743 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:54.805820 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:54.805920 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:54.807700 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:54.808906 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:54.811292 (+ 2386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:54.812017 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:54.812191 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:54.815210 (+ 3019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:54.815216 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:54.815219 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:54.815260 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:54.818638 (+ 3378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:54.819793 (+ 1155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:54.819802 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:54.819808 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:54.820025 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:54.820644 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:54.820651 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:54.820656 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:54.821139 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:54.821327 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:54.821799 (+ 472us) server_negotiation.cc:299] Negotiation successful
0808 23:33:54.822062 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260808 23:33:54.822567 3199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:54.804394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:45653 (local address 127.26.207.193:44013)
0808 23:33:54.805274 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:54.805305 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:54.805540 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:54.806002 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:54.806010 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:54.806887 (+ 877us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:54.807473 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:54.807493 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:54.809095 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:54.809106 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:54.811019 (+ 1913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:54.811067 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:54.812335 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:54.812346 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:54.812644 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:54.813735 (+ 1091us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:54.813779 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:54.814917 (+ 1138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:54.818835 (+ 3918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:54.818842 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:54.818847 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:54.819592 (+ 745us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:54.820227 (+ 635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:54.820232 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:54.820237 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:54.820463 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:54.821293 (+ 830us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:54.821298 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:54.821504 (+ 206us) client_negotiation.cc:769] Sending connection context
0808 23:33:54.821671 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 23:33:54.822069 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":649,"thread_start_us":441,"threads_started":1}
I20260808 23:33:54.835358 3101 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:45331
I20260808 23:33:54.835414 3243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:45331 every 8 connection(s)
I20260808 23:33:54.837357 3101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:33:54.840140 3244 heartbeater.cc:347] Connected to a master server at 127.26.207.254:45653
I20260808 23:33:54.840387 3244 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:54.841169 3244 heartbeater.cc:511] Master 127.26.207.254:45653 requested a full tablet report, sending...
I20260808 23:33:54.843443 3025 ts_manager.cc:194] Registered new tserver with Master: b0fd7a69469d49b482d49c53c6a06c12 (127.26.207.193:45331)
I20260808 23:33:54.844389 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 3101
I20260808 23:33:54.844610 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:33:54.845283 3025 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:43953
I20260808 23:33:54.845362 27455 external_mini_cluster.cc:1428] Setting key b2aada6bf40acd11e58d02bc0695f489
WARNING: no policy specified for oryx/127.26.207.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.207.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.194.keytab.
Entry for principal oryx/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.194.keytab.
I20260808 23:33:54.913118 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:45653
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.194.keytab
--principal=oryx/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:36167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:33:55.290414 3249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:55.290750 3249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:55.290926 3249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:55.299600 3249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:55.299736 3249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:55.299890 3249 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 23:33:55.299988 3249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:33:55.311113 3249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:36167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.194.keytab
--principal=oryx/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.207.254:45653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:55.312626 3249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:55.314203 3249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:55.330225 3254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:55.330016 3257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:55.330016 3255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:55.331599 3249 server_base.cc:1034] running on GCE node
I20260808 23:33:55.332479 3249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:55.333792 3249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:55.335106 3249 hybrid_clock.cc:648] HybridClock initialized: now 1786232035335030 us; error 76 us; skew 500 ppm
I20260808 23:33:55.335479 3249 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:55 dist-test-slave-1x4g krb5kdc[2977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232035, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:55.339488 3249 init.cc:377] Logged in from keytab as oryx/127.26.207.194@KRBTEST.COM (short username oryx)
I20260808 23:33:55.341470 3249 webserver.cc:460] Webserver started at http://127.26.207.194:39451/ using document root <none> and password file <none>
I20260808 23:33:55.342330 3249 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:55.342494 3249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:55.342876 3249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:55.346701 3249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "d8caa041c5284b74b44d6546cad6c7fb"
format_stamp: "Formatted at 2026-08-08 23:33:55 on dist-test-slave-1x4g"
server_key: "14daec77ac3fe90334df1981503f2ec4"
server_key_iv: "667916f8d6ba10a00b20c5326576bfa1"
server_key_version: "encryptionkey@0"
I20260808 23:33:55.347862 3249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "d8caa041c5284b74b44d6546cad6c7fb"
format_stamp: "Formatted at 2026-08-08 23:33:55 on dist-test-slave-1x4g"
server_key: "14daec77ac3fe90334df1981503f2ec4"
server_key_iv: "667916f8d6ba10a00b20c5326576bfa1"
server_key_version: "encryptionkey@0"
I20260808 23:33:55.354563 3249 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 23:33:55.359131 3264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:55.361056 3249 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:33:55.361295 3249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "d8caa041c5284b74b44d6546cad6c7fb"
format_stamp: "Formatted at 2026-08-08 23:33:55 on dist-test-slave-1x4g"
server_key: "14daec77ac3fe90334df1981503f2ec4"
server_key_iv: "667916f8d6ba10a00b20c5326576bfa1"
server_key_version: "encryptionkey@0"
I20260808 23:33:55.361586 3249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:55.393287 3249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:55.398748 3249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:55.399104 3249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:55.402539 3249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:55.402660 3249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:55.402801 3249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:55.402884 3249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 23:33:55 dist-test-slave-1x4g krb5kdc[2977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232035, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM
I20260808 23:33:55.432227 3273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:55.403187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:57677 (local address 127.26.207.254:45653)
0808 23:33:55.404075 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:55.404080 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:55.405355 (+ 1275us) server_negotiation.cc:407] Connection header received
0808 23:33:55.407637 (+ 2282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:55.407643 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:55.407745 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:55.407891 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:55.410691 (+ 2800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:55.412150 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:55.414944 (+ 2794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:55.415687 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:55.415855 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:55.422256 (+ 6401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:55.422268 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:55.422277 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:55.422342 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:55.427035 (+ 4693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:55.428692 (+ 1657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:55.428703 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:55.428709 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:55.428998 (+ 289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:55.429852 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:55.429859 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:55.429863 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:55.430256 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:55.430497 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:55.431439 (+ 942us) server_negotiation.cc:299] Negotiation successful
0808 23:33:55.431769 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":771,"thread_start_us":656,"threads_started":1}
I20260808 23:33:55.433806 3274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:55.403991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:45653 (local address 127.26.207.194:57677)
0808 23:33:55.405140 (+ 1149us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:55.405195 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:55.407261 (+ 2066us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:55.408223 (+ 962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:55.408244 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:55.409336 (+ 1092us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:55.410362 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:55.410411 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:55.412417 (+ 2006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:55.412426 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:55.414723 (+ 2297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:55.414743 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:55.415999 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:55.416008 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:55.416259 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:55.417278 (+ 1019us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:55.417325 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:55.421757 (+ 4432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:55.427329 (+ 5572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:55.427342 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:55.427369 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:55.428428 (+ 1059us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:55.429206 (+ 778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:55.429214 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:55.429221 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:55.429648 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:55.430466 (+ 818us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:55.430476 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:55.430939 (+ 463us) client_negotiation.cc:769] Sending connection context
0808 23:33:55.431285 (+ 346us) client_negotiation.cc:240] Negotiation successful
0808 23:33:55.431938 (+ 653us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":816,"thread_start_us":534,"threads_started":1}
I20260808 23:33:55.459355 3351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:55.441692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:45653 (local address 127.26.207.194:60703)
0808 23:33:55.442551 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:55.442582 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:55.442814 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:55.443315 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:55.443323 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:55.444209 (+ 886us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:55.444734 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:55.444755 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:55.446376 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:55.446386 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:55.448684 (+ 2298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:55.448724 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:55.450269 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:55.450275 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:55.450423 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:55.451192 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:55.451212 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:55.452421 (+ 1209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:55.456048 (+ 3627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:55.456053 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:55.456058 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:55.456521 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:55.457077 (+ 556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:55.457082 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:55.457086 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:55.457295 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:55.458338 (+ 1043us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:55.458344 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:55.458542 (+ 198us) client_negotiation.cc:769] Sending connection context
0808 23:33:55.458697 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 23:33:55.458995 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":431,"threads_started":1}
I20260808 23:33:55.459853 3273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:55.441709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:60703 (local address 127.26.207.254:45653)
0808 23:33:55.441986 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:55.441996 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:55.442733 (+ 737us) server_negotiation.cc:407] Connection header received
0808 23:33:55.442971 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:55.442976 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:55.443116 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:55.443220 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:55.445038 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:55.446161 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:55.448967 (+ 2806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:55.449752 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:55.449935 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:55.452710 (+ 2775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:55.452717 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:55.452720 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:55.452758 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:55.455883 (+ 3125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:55.456703 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:55.456710 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:55.456713 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:55.456932 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:55.457544 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:55.457553 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:55.457558 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:55.458155 (+ 597us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:55.458362 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:55.458899 (+ 537us) server_negotiation.cc:299] Negotiation successful
0808 23:33:55.459255 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 23:33:55.467633 3249 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:34283
I20260808 23:33:55.467651 3388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:34283 every 8 connection(s)
I20260808 23:33:55.469112 3249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:33:55.471551 3390 heartbeater.cc:347] Connected to a master server at 127.26.207.254:45653
I20260808 23:33:55.471841 3390 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:55.472615 3390 heartbeater.cc:511] Master 127.26.207.254:45653 requested a full tablet report, sending...
I20260808 23:33:55.474288 3025 ts_manager.cc:194] Registered new tserver with Master: d8caa041c5284b74b44d6546cad6c7fb (127.26.207.194:34283)
I20260808 23:33:55.475222 3025 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:57677
I20260808 23:33:55.476814 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 3249
I20260808 23:33:55.476996 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:33:55.477569 27455 external_mini_cluster.cc:1428] Setting key 3ef0c65d8615c3291ef533ab7a1504ee
WARNING: no policy specified for oryx/127.26.207.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.195.keytab.
Entry for principal oryx/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.195.keytab.
I20260808 23:33:55.546445 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:45653
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.195.keytab
--principal=oryx/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:36167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:33:55.849282 3244 heartbeater.cc:503] Master 127.26.207.254:45653 was elected leader, sending a full tablet report...
W20260808 23:33:55.925302 3394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:33:55.925747 3394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:33:55.925861 3394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:33:55.933463 3394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:33:55.933607 3394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:33:55.933702 3394 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 23:33:55.933780 3394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:33:55.944490 3394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:36167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.195.keytab
--principal=oryx/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.207.254:45653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:33:55.946197 3394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:33:55.947734 3394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:33:55.962918 3399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:55.962904 3400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:33:55.962940 3402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:33:55.963627 3394 server_base.cc:1034] running on GCE node
I20260808 23:33:55.964347 3394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:33:55.965601 3394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:33:55.966871 3394 hybrid_clock.cc:648] HybridClock initialized: now 1786232035966786 us; error 70 us; skew 500 ppm
I20260808 23:33:55.967229 3394 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:33:55 dist-test-slave-1x4g krb5kdc[2977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232035, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:33:55.971002 3394 init.cc:377] Logged in from keytab as oryx/127.26.207.195@KRBTEST.COM (short username oryx)
I20260808 23:33:55.972735 3394 webserver.cc:460] Webserver started at http://127.26.207.195:37431/ using document root <none> and password file <none>
I20260808 23:33:55.973628 3394 fs_manager.cc:359] Metadata directory not provided
I20260808 23:33:55.973767 3394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:33:55.974143 3394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:33:55.977495 3394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4"
format_stamp: "Formatted at 2026-08-08 23:33:55 on dist-test-slave-1x4g"
server_key: "c048a13a9795d3466a6e4f54b23478b9"
server_key_iv: "b707f6efec7e57033ad5c1771b762fa6"
server_key_version: "encryptionkey@0"
I20260808 23:33:55.978421 3394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4"
format_stamp: "Formatted at 2026-08-08 23:33:55 on dist-test-slave-1x4g"
server_key: "c048a13a9795d3466a6e4f54b23478b9"
server_key_iv: "b707f6efec7e57033ad5c1771b762fa6"
server_key_version: "encryptionkey@0"
I20260808 23:33:55.985028 3394 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 23:33:55.989355 3409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:55.991060 3394 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 23:33:55.991303 3394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4"
format_stamp: "Formatted at 2026-08-08 23:33:55 on dist-test-slave-1x4g"
server_key: "c048a13a9795d3466a6e4f54b23478b9"
server_key_iv: "b707f6efec7e57033ad5c1771b762fa6"
server_key_version: "encryptionkey@0"
I20260808 23:33:55.991586 3394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:33:56.017211 3394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:33:56.022210 3394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:33:56.022557 3394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:33:56.025787 3394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:33:56.025915 3394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:33:56.026065 3394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:33:56.026150 3394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 23:33:56 dist-test-slave-1x4g krb5kdc[2977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232035, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM
I20260808 23:33:56.059716 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:56.026503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:52487 (local address 127.26.207.254:45653)
0808 23:33:56.027139 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:56.027144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:56.028331 (+ 1187us) server_negotiation.cc:407] Connection header received
0808 23:33:56.030597 (+ 2266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:56.030603 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:56.030703 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:56.030841 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:56.034483 (+ 3642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.035546 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.039559 (+ 4013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.040099 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.040228 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.048079 (+ 7851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:56.048089 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:56.048098 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:56.048169 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:56.054472 (+ 6303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:56.056000 (+ 1528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:56.056007 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:56.056010 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:56.056269 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:56.057371 (+ 1102us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:56.057380 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:56.057386 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:56.057793 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:56.058033 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:56.058966 (+ 933us) server_negotiation.cc:299] Negotiation successful
0808 23:33:56.059277 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":401,"threads_started":1}
I20260808 23:33:56.061056 3421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:56.027226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:45653 (local address 127.26.207.195:52487)
0808 23:33:56.028123 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:56.028186 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:56.030231 (+ 2045us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:56.031242 (+ 1011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:56.031261 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:56.032374 (+ 1113us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:56.034080 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:56.034132 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.035796 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.035803 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:56.039253 (+ 3450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:56.039280 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.040603 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.040613 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:56.041375 (+ 762us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.042557 (+ 1182us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:56.042636 (+ 79us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:56.047599 (+ 4963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:56.054827 (+ 7228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:56.054845 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:56.054876 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:56.055767 (+ 891us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:56.056464 (+ 697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:56.056472 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:56.056477 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:56.057114 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:56.058002 (+ 888us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:56.058013 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:56.058486 (+ 473us) client_negotiation.cc:769] Sending connection context
0808 23:33:56.058826 (+ 340us) client_negotiation.cc:240] Negotiation successful
0808 23:33:56.059474 (+ 648us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":378,"threads_started":1}
I20260808 23:33:56.084093 3394 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:39973
I20260808 23:33:56.084120 3537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:39973 every 8 connection(s)
I20260808 23:33:56.085861 3394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:33:56.089207 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 3394
I20260808 23:33:56.089438 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:33:56.089772 3538 heartbeater.cc:347] Connected to a master server at 127.26.207.254:45653
I20260808 23:33:56.090003 3538 heartbeater.cc:464] Registering TS with master...
I20260808 23:33:56.090099 27455 external_mini_cluster.cc:1428] Setting key ea628b10bdbff96c4044657e981e5293
I20260808 23:33:56.090866 3538 heartbeater.cc:511] Master 127.26.207.254:45653 requested a full tablet report, sending...
I20260808 23:33:56.092849 3025 ts_manager.cc:194] Registered new tserver with Master: 82f1488ae45a4bc1b3f85bb4e8ad42e4 (127.26.207.195:39973)
I20260808 23:33:56.094115 3025 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:52487
I20260808 23:33:56.094877 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:33:56.096410 3525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:56.076940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:45653 (local address 127.26.207.195:40171)
0808 23:33:56.078883 (+ 1943us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:56.078919 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:56.079147 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:56.080035 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:56.080041 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:56.081071 (+ 1030us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:56.081654 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:56.081673 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.083229 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.083235 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:56.084561 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:56.084580 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.085565 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.085577 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:56.085762 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.086551 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:56.086570 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:56.087450 (+ 880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:56.092589 (+ 5139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:56.092597 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:56.092601 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:56.093356 (+ 755us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:56.093873 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:56.093881 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:56.093886 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:56.094056 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:56.094832 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:56.094838 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:56.095138 (+ 300us) client_negotiation.cc:769] Sending connection context
0808 23:33:56.095286 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 23:33:56.095752 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1711,"mutex_wait_us":4,"thread_start_us":724,"threads_started":1}
I20260808 23:33:56.097981 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:56.076914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:40171 (local address 127.26.207.254:45653)
0808 23:33:56.077139 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:56.077146 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:56.079067 (+ 1921us) server_negotiation.cc:407] Connection header received
0808 23:33:56.079458 (+ 391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:56.079467 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:56.079591 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:56.079754 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:56.081886 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.083010 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.084797 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.085307 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.085484 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.087734 (+ 2250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:56.087741 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:56.087748 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:56.087805 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:56.092359 (+ 4554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:56.093536 (+ 1177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:56.093540 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:56.093543 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:56.093720 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:56.094222 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:56.094229 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:56.094234 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:56.094638 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:56.096984 (+ 2346us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:56.097155 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 23:33:56.097463 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
Aug 08 23:33:56 dist-test-slave-1x4g krb5kdc[2977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232036, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 23:33:56 dist-test-slave-1x4g krb5kdc[2977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:33:56 dist-test-slave-1x4g krb5kdc[2977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 23:33:56.167567 3420 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:33:56.154487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40406 (local address 127.26.207.254:45653)
0808 23:33:56.154692 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:56.154697 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:56.154965 (+ 268us) server_negotiation.cc:407] Connection header received
0808 23:33:56.155328 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:56.155333 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:56.155481 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:56.155612 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:56.157644 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.158447 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.159881 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.160375 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.160518 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.167259 (+ 6741us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40406: BlockingRecv error: recv got EOF from 127.0.0.1:40406 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 08 23:33:56 dist-test-slave-1x4g krb5kdc[2977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232036, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM
I20260808 23:33:56.186728 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:56.171761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40418 (local address 127.26.207.254:45653)
0808 23:33:56.171952 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:56.171957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:56.172309 (+ 352us) server_negotiation.cc:407] Connection header received
0808 23:33:56.172509 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:56.172514 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:56.172587 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:56.172688 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:56.174154 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.174939 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.176252 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.176742 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.176950 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.181380 (+ 4430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:56.181387 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:56.181390 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:56.181435 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:56.184020 (+ 2585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:56.184938 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:56.184943 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:56.184946 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:56.185098 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:56.185493 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:56.185496 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:56.185498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:56.185789 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:56.186027 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:56.186290 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 23:33:56.186490 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 23:33:56.191727 3025 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40418:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:33:56.200297 3025 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:33:56.239329 3563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:56.216577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47388 (local address 127.26.207.194:34283)
0808 23:33:56.229450 (+ 12873us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:56.229465 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:56.229513 (+ 48us) server_negotiation.cc:407] Connection header received
0808 23:33:56.229670 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:56.229684 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:56.230128 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:56.230437 (+ 309us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:56.231799 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.233526 (+ 1727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.236026 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.237963 (+ 1937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.238190 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.238424 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:56.238787 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 23:33:56.238985 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12576,"thread_start_us":12380,"threads_started":1}
I20260808 23:33:56.239530 3564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:56.217011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:34283 (local address 127.0.0.1:47388)
0808 23:33:56.228471 (+ 11460us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:56.228505 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:56.228683 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:56.230790 (+ 2107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:56.230802 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:56.230845 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:56.231557 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:56.231576 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.233726 (+ 2150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.233732 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:56.235796 (+ 2064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:56.235812 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.238203 (+ 2391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.238210 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:56.238463 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.238524 (+ 61us) client_negotiation.cc:769] Sending connection context
0808 23:33:56.238688 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 23:33:56.238978 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11265,"mutex_wait_us":138,"thread_start_us":11059,"threads_started":1}
I20260808 23:33:56.239558 3559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:56.214848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:45331 (local address 127.0.0.1:49532)
0808 23:33:56.215692 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:56.215753 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:56.215963 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:56.230865 (+ 14902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:56.230872 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:56.230892 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:56.231639 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:56.231657 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.233671 (+ 2014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.233677 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:56.236173 (+ 2496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:56.236190 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.238371 (+ 2181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.238382 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:56.238552 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.238577 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 23:33:56.238647 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 23:33:56.238976 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"mutex_wait_us":45,"thread_start_us":342,"threads_started":1}
I20260808 23:33:56.240576 3561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:56.215446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:39973 (local address 127.0.0.1:42046)
0808 23:33:56.227089 (+ 11643us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:56.227128 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:56.227375 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:56.232136 (+ 4761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:56.232143 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:56.232173 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:56.232562 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:56.232576 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.234755 (+ 2179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.234764 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:56.237455 (+ 2691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:56.237471 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.239714 (+ 2243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.239721 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:56.239910 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.239948 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 23:33:56.240024 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 23:33:56.240196 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11366,"mutex_wait_us":1,"thread_start_us":12082,"threads_started":1}
I20260808 23:33:56.240629 3560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:56.215031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49532 (local address 127.26.207.193:45331)
0808 23:33:56.230212 (+ 15181us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:56.230223 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:56.230257 (+ 34us) server_negotiation.cc:407] Connection header received
0808 23:33:56.230381 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:56.230390 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:56.230634 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:56.231268 (+ 634us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:56.231902 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.233466 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.236348 (+ 2882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.238113 (+ 1765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.239986 (+ 1873us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.240187 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:56.240254 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 23:33:56.240396 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14979,"thread_start_us":15393,"threads_started":1}
I20260808 23:33:56.242048 3562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:56.216176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42046 (local address 127.26.207.195:39973)
0808 23:33:56.231317 (+ 15141us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:56.231327 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:56.231364 (+ 37us) server_negotiation.cc:407] Connection header received
0808 23:33:56.231490 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:56.231501 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:56.231741 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:56.231959 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:56.232860 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.234553 (+ 1693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.237705 (+ 3152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.239436 (+ 1731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.241202 (+ 1766us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.241412 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:56.241509 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 23:33:56.241690 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14966,"thread_start_us":14750,"threads_started":1}
I20260808 23:33:56.244573 3317 tablet_service.cc:1467] Processing CreateTablet for tablet 9de29e5a6a08443aa432f3b087b75d94 (DEFAULT_TABLE table=test-table [id=4ad2c8a6b8304ab487edb4827a76fde5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:56.246097 3317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9de29e5a6a08443aa432f3b087b75d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:56.246188 3464 tablet_service.cc:1467] Processing CreateTablet for tablet 9de29e5a6a08443aa432f3b087b75d94 (DEFAULT_TABLE table=test-table [id=4ad2c8a6b8304ab487edb4827a76fde5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:56.246191 3169 tablet_service.cc:1467] Processing CreateTablet for tablet 9de29e5a6a08443aa432f3b087b75d94 (DEFAULT_TABLE table=test-table [id=4ad2c8a6b8304ab487edb4827a76fde5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:56.247752 3169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9de29e5a6a08443aa432f3b087b75d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:56.247778 3464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9de29e5a6a08443aa432f3b087b75d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:56.260092 3565 tablet_bootstrap.cc:492] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb: Bootstrap starting.
I20260808 23:33:56.264317 3565 tablet_bootstrap.cc:654] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:56.266193 3565 log.cc:824] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:56.266831 3566 tablet_bootstrap.cc:492] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Bootstrap starting.
I20260808 23:33:56.267297 3567 tablet_bootstrap.cc:492] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12: Bootstrap starting.
I20260808 23:33:56.270445 3565 tablet_bootstrap.cc:492] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb: No bootstrap required, opened a new log
I20260808 23:33:56.270808 3565 ts_tablet_manager.cc:1397] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260808 23:33:56.271334 3567 tablet_bootstrap.cc:654] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:56.271334 3566 tablet_bootstrap.cc:654] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:56.272848 3566 log.cc:824] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:56.272850 3567 log.cc:824] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12: Log is configured to *not* fsync() on all Append() calls
I20260808 23:33:56.281378 3565 raft_consensus.cc:348] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:56.281876 3565 raft_consensus.cc:374] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:56.282027 3565 raft_consensus.cc:729] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8caa041c5284b74b44d6546cad6c7fb, State: Initialized, Role: FOLLOWER
I20260808 23:33:56.282761 3565 consensus_queue.cc:260] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:56.283048 3566 tablet_bootstrap.cc:492] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: No bootstrap required, opened a new log
I20260808 23:33:56.283051 3567 tablet_bootstrap.cc:492] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12: No bootstrap required, opened a new log
I20260808 23:33:56.283403 3566 ts_tablet_manager.cc:1397] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.012s
I20260808 23:33:56.283403 3567 ts_tablet_manager.cc:1397] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.007s
I20260808 23:33:56.286324 3390 heartbeater.cc:503] Master 127.26.207.254:45653 was elected leader, sending a full tablet report...
I20260808 23:33:56.287151 3565 ts_tablet_manager.cc:1428] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb: Time spent starting tablet: real 0.016s user 0.013s sys 0.004s
I20260808 23:33:56.294019 3566 raft_consensus.cc:348] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:56.294556 3566 raft_consensus.cc:374] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:56.294716 3566 raft_consensus.cc:729] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f1488ae45a4bc1b3f85bb4e8ad42e4, State: Initialized, Role: FOLLOWER
I20260808 23:33:56.295576 3567 raft_consensus.cc:348] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:56.295768 3566 consensus_queue.cc:260] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:56.296150 3567 raft_consensus.cc:374] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:56.296280 3567 raft_consensus.cc:729] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0fd7a69469d49b482d49c53c6a06c12, State: Initialized, Role: FOLLOWER
I20260808 23:33:56.297353 3538 heartbeater.cc:503] Master 127.26.207.254:45653 was elected leader, sending a full tablet report...
I20260808 23:33:56.297168 3567 consensus_queue.cc:260] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:56.298257 3566 ts_tablet_manager.cc:1428] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Time spent starting tablet: real 0.015s user 0.008s sys 0.005s
I20260808 23:33:56.301041 3567 ts_tablet_manager.cc:1428] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12: Time spent starting tablet: real 0.018s user 0.011s sys 0.006s
W20260808 23:33:56.341161 3246 tablet.cc:2369] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:33:56.342092 3539 tablet.cc:2369] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:33:56.471551 3391 tablet.cc:2369] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:33:56.577893 3571 raft_consensus.cc:482] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:33:56.578310 3571 raft_consensus.cc:504] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:56.580237 3571 leader_election.cc:288] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0fd7a69469d49b482d49c53c6a06c12 (127.26.207.193:45331), 82f1488ae45a4bc1b3f85bb4e8ad42e4 (127.26.207.195:39973)
I20260808 23:33:56.595594 3562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:56.580843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:42665 (local address 127.26.207.195:39973)
0808 23:33:56.581055 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:56.581064 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:56.584130 (+ 3066us) server_negotiation.cc:407] Connection header received
0808 23:33:56.584398 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:56.584404 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:56.584491 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:56.584554 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:56.586290 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.587317 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.591904 (+ 4587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.593689 (+ 1785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.593893 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.594005 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:56.595241 (+ 1236us) server_negotiation.cc:299] Negotiation successful
0808 23:33:56.595370 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 23:33:56.595674 3576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:56.580884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:39973 (local address 127.26.207.194:42665)
0808 23:33:56.584017 (+ 3133us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:56.584036 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:56.584234 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:56.584744 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:56.584747 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:56.584768 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:56.586050 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:56.586064 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.587517 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.587522 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:56.590357 (+ 2835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:56.590388 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.594857 (+ 4469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.594863 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:56.595018 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.595046 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 23:33:56.595178 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 23:33:56.595320 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2972,"mutex_wait_us":6,"thread_start_us":694,"threads_started":1}
I20260808 23:33:56.596836 3486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9de29e5a6a08443aa432f3b087b75d94" candidate_uuid: "d8caa041c5284b74b44d6546cad6c7fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" is_pre_election: true
I20260808 23:33:56.597110 3560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:56.580716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:43507 (local address 127.26.207.193:45331)
0808 23:33:56.580987 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:56.580997 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:56.583922 (+ 2925us) server_negotiation.cc:407] Connection header received
0808 23:33:56.584290 (+ 368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:56.584296 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:56.584400 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:56.584493 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:56.585889 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.587083 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.592953 (+ 5870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.594407 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.594649 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.594741 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:56.596649 (+ 1908us) server_negotiation.cc:299] Negotiation successful
0808 23:33:56.596835 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260808 23:33:56.597236 3575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:56.580716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:45331 (local address 127.26.207.194:43507)
0808 23:33:56.583754 (+ 3038us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:56.583780 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:56.584079 (+ 299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:56.584735 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:56.584739 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:56.584848 (+ 109us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:56.585633 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:56.585651 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.587300 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.587304 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:56.592024 (+ 4720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:56.592696 (+ 672us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.596257 (+ 3561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.596266 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:56.596426 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.596451 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 23:33:56.596561 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 23:33:56.596743 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2812,"mutex_wait_us":262,"spinlock_wait_cycles":25856,"thread_start_us":581,"threads_started":1}
I20260808 23:33:56.597466 3486 raft_consensus.cc:2454] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8caa041c5284b74b44d6546cad6c7fb in term 0.
I20260808 23:33:56.598477 3191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9de29e5a6a08443aa432f3b087b75d94" candidate_uuid: "d8caa041c5284b74b44d6546cad6c7fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0fd7a69469d49b482d49c53c6a06c12" is_pre_election: true
I20260808 23:33:56.599114 3191 raft_consensus.cc:2454] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8caa041c5284b74b44d6546cad6c7fb in term 0.
I20260808 23:33:56.599591 3268 leader_election.cc:302] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f1488ae45a4bc1b3f85bb4e8ad42e4, d8caa041c5284b74b44d6546cad6c7fb; no voters:
I20260808 23:33:56.600160 3571 raft_consensus.cc:2781] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:33:56.600374 3571 raft_consensus.cc:482] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:33:56.600533 3571 raft_consensus.cc:3037] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:56.605006 3571 raft_consensus.cc:504] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:56.606043 3571 leader_election.cc:288] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [CANDIDATE]: Term 1 election: Requested vote from peers b0fd7a69469d49b482d49c53c6a06c12 (127.26.207.193:45331), 82f1488ae45a4bc1b3f85bb4e8ad42e4 (127.26.207.195:39973)
I20260808 23:33:56.606678 3191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9de29e5a6a08443aa432f3b087b75d94" candidate_uuid: "d8caa041c5284b74b44d6546cad6c7fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0fd7a69469d49b482d49c53c6a06c12"
I20260808 23:33:56.606755 3486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9de29e5a6a08443aa432f3b087b75d94" candidate_uuid: "d8caa041c5284b74b44d6546cad6c7fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4"
I20260808 23:33:56.606953 3191 raft_consensus.cc:3037] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:56.607259 3486 raft_consensus.cc:3037] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:56.610033 3191 raft_consensus.cc:2454] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8caa041c5284b74b44d6546cad6c7fb in term 1.
I20260808 23:33:56.610801 3267 leader_election.cc:302] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0fd7a69469d49b482d49c53c6a06c12, d8caa041c5284b74b44d6546cad6c7fb; no voters:
I20260808 23:33:56.611328 3571 raft_consensus.cc:2781] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:56.611368 3486 raft_consensus.cc:2454] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8caa041c5284b74b44d6546cad6c7fb in term 1.
I20260808 23:33:56.612006 3571 raft_consensus.cc:686] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [term 1 LEADER]: Becoming Leader. State: Replica: d8caa041c5284b74b44d6546cad6c7fb, State: Running, Role: LEADER
I20260808 23:33:56.612609 3571 consensus_queue.cc:237] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:56.617563 3024 catalog_manager.cc:5495] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb reported cstate change: term changed from 0 to 1, leader changed from <none> to d8caa041c5284b74b44d6546cad6c7fb (127.26.207.194). New cstate: current_term: 1 leader_uuid: "d8caa041c5284b74b44d6546cad6c7fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260808 23:33:56.705946 3563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:56.699076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47392 (local address 127.26.207.194:34283)
0808 23:33:56.699370 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:56.699379 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:56.699949 (+ 570us) server_negotiation.cc:407] Connection header received
0808 23:33:56.700273 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:56.700279 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:56.700400 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:56.700620 (+ 220us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:56.701133 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.701914 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.703388 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:56.703858 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:56.704015 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:56.704518 (+ 503us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:56.705229 (+ 711us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:56.705415 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:56.705546 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 23:33:56.705643 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 23:33:56.715374 3191 raft_consensus.cc:1261] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Refusing update from remote peer d8caa041c5284b74b44d6546cad6c7fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:56.715374 3486 raft_consensus.cc:1261] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Refusing update from remote peer d8caa041c5284b74b44d6546cad6c7fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:56.716828 3577 consensus_queue.cc:1035] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:56.717552 3571 consensus_queue.cc:1035] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:56.734596 3582 mvcc.cc:205] Tried to move back new op lower bound from 7316406422373924864 to 7316406421970096128. Current Snapshot: MvccSnapshot[applied={T|T < 7316406422373924864}]
I20260808 23:33:56.735236 3584 mvcc.cc:205] Tried to move back new op lower bound from 7316406422373924864 to 7316406421970096128. Current Snapshot: MvccSnapshot[applied={T|T < 7316406422373924864}]
I20260808 23:33:56.750923 3583 mvcc.cc:205] Tried to move back new op lower bound from 7316406422373924864 to 7316406421970096128. Current Snapshot: MvccSnapshot[applied={T|T < 7316406422373924864}]
I20260808 23:33:56.766865 3024 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:56.767210 3024 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:56.772406 3024 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b: Sending DeleteTablet for 3 replicas of tablet 9de29e5a6a08443aa432f3b087b75d94
I20260808 23:33:56.774022 3464 tablet_service.cc:1514] Processing DeleteTablet for tablet 9de29e5a6a08443aa432f3b087b75d94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:56 UTC) from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:42046
I20260808 23:33:56.774083 3169 tablet_service.cc:1514] Processing DeleteTablet for tablet 9de29e5a6a08443aa432f3b087b75d94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:56 UTC) from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:49532
I20260808 23:33:56.774912 3317 tablet_service.cc:1514] Processing DeleteTablet for tablet 9de29e5a6a08443aa432f3b087b75d94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:56 UTC) from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:47388
I20260808 23:33:56.775211 3592 tablet_replica.cc:330] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: stopping tablet replica
I20260808 23:33:56.775820 3592 raft_consensus.cc:2229] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:56.776633 3592 raft_consensus.cc:2258] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:56.778391 3025 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40418:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:33:56.779182 3025 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:33:56.779493 3592 ts_tablet_manager.cc:1905] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:56.789261 3592 ts_tablet_manager.cc:1918] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:56.789409 3168 tablet_service.cc:1467] Processing CreateTablet for tablet 5531dfc622ce489a85557c7c03b1288c (DEFAULT_TABLE table=test-table [id=316bc094c82a417e8bd9a604f160b6f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:56.789604 3592 log.cc:1196] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/9de29e5a6a08443aa432f3b087b75d94
I20260808 23:33:56.790149 3168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5531dfc622ce489a85557c7c03b1288c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:56.790321 3592 ts_tablet_manager.cc:1939] T 9de29e5a6a08443aa432f3b087b75d94 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Deleting consensus metadata
I20260808 23:33:56.793535 3011 catalog_manager.cc:4841] TS 82f1488ae45a4bc1b3f85bb4e8ad42e4 (127.26.207.195:39973): tablet 9de29e5a6a08443aa432f3b087b75d94 (table test-table [id=4ad2c8a6b8304ab487edb4827a76fde5]) successfully deleted
I20260808 23:33:56.794118 3464 tablet_service.cc:1467] Processing CreateTablet for tablet 5531dfc622ce489a85557c7c03b1288c (DEFAULT_TABLE table=test-table [id=316bc094c82a417e8bd9a604f160b6f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:56.794572 3316 tablet_service.cc:1467] Processing CreateTablet for tablet 5531dfc622ce489a85557c7c03b1288c (DEFAULT_TABLE table=test-table [id=316bc094c82a417e8bd9a604f160b6f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:56.794834 3464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5531dfc622ce489a85557c7c03b1288c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:56.795213 3316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5531dfc622ce489a85557c7c03b1288c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:56.796336 3594 tablet_replica.cc:330] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb: stopping tablet replica
I20260808 23:33:56.797137 3594 raft_consensus.cc:2229] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:33:56.797955 3594 raft_consensus.cc:2258] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:56.800740 3594 ts_tablet_manager.cc:1905] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:56.805344 3593 tablet_replica.cc:330] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12: stopping tablet replica
I20260808 23:33:56.806022 3593 raft_consensus.cc:2229] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:56.806674 3593 raft_consensus.cc:2258] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:56.809209 3593 ts_tablet_manager.cc:1905] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:56.817657 3593 ts_tablet_manager.cc:1918] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:56.824259 3594 ts_tablet_manager.cc:1918] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:56.824640 3594 log.cc:1196] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/9de29e5a6a08443aa432f3b087b75d94
I20260808 23:33:56.825445 3594 ts_tablet_manager.cc:1939] T 9de29e5a6a08443aa432f3b087b75d94 P d8caa041c5284b74b44d6546cad6c7fb: Deleting consensus metadata
I20260808 23:33:56.825747 3593 log.cc:1196] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/9de29e5a6a08443aa432f3b087b75d94
I20260808 23:33:56.828219 3010 catalog_manager.cc:4841] TS d8caa041c5284b74b44d6546cad6c7fb (127.26.207.194:34283): tablet 9de29e5a6a08443aa432f3b087b75d94 (table test-table [id=4ad2c8a6b8304ab487edb4827a76fde5]) successfully deleted
I20260808 23:33:56.828662 3593 ts_tablet_manager.cc:1939] T 9de29e5a6a08443aa432f3b087b75d94 P b0fd7a69469d49b482d49c53c6a06c12: Deleting consensus metadata
I20260808 23:33:56.831080 3010 catalog_manager.cc:4841] TS b0fd7a69469d49b482d49c53c6a06c12 (127.26.207.193:45331): tablet 9de29e5a6a08443aa432f3b087b75d94 (table test-table [id=4ad2c8a6b8304ab487edb4827a76fde5]) successfully deleted
I20260808 23:33:56.833528 3595 tablet_bootstrap.cc:492] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb: Bootstrap starting.
I20260808 23:33:56.834199 3596 tablet_bootstrap.cc:492] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Bootstrap starting.
I20260808 23:33:56.835155 3597 tablet_bootstrap.cc:492] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12: Bootstrap starting.
I20260808 23:33:56.838577 3596 tablet_bootstrap.cc:654] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:56.841509 3597 tablet_bootstrap.cc:654] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:56.842836 3595 tablet_bootstrap.cc:654] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:56.844869 3596 tablet_bootstrap.cc:492] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: No bootstrap required, opened a new log
I20260808 23:33:56.848104 3596 ts_tablet_manager.cc:1397] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260808 23:33:56.850353 3596 raft_consensus.cc:348] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:56.850929 3596 raft_consensus.cc:374] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:56.851111 3596 raft_consensus.cc:729] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f1488ae45a4bc1b3f85bb4e8ad42e4, State: Initialized, Role: FOLLOWER
I20260808 23:33:56.851639 3596 consensus_queue.cc:260] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:56.853549 3596 ts_tablet_manager.cc:1428] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260808 23:33:56.854586 3597 tablet_bootstrap.cc:492] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12: No bootstrap required, opened a new log
I20260808 23:33:56.854758 3597 ts_tablet_manager.cc:1397] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.006s
I20260808 23:33:56.855659 3597 raft_consensus.cc:348] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:56.855923 3597 raft_consensus.cc:374] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:56.856022 3597 raft_consensus.cc:729] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0fd7a69469d49b482d49c53c6a06c12, State: Initialized, Role: FOLLOWER
I20260808 23:33:56.856287 3597 consensus_queue.cc:260] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:56.857004 3597 ts_tablet_manager.cc:1428] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 23:33:56.859261 3595 tablet_bootstrap.cc:492] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb: No bootstrap required, opened a new log
I20260808 23:33:56.859511 3595 ts_tablet_manager.cc:1397] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.005s
I20260808 23:33:56.860589 3595 raft_consensus.cc:348] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:56.861048 3595 raft_consensus.cc:374] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:56.861224 3595 raft_consensus.cc:729] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8caa041c5284b74b44d6546cad6c7fb, State: Initialized, Role: FOLLOWER
I20260808 23:33:56.861642 3595 consensus_queue.cc:260] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:56.865450 3595 ts_tablet_manager.cc:1428] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260808 23:33:57.150839 3571 raft_consensus.cc:482] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:33:57.151144 3571 raft_consensus.cc:504] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.152128 3571 leader_election.cc:288] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0fd7a69469d49b482d49c53c6a06c12 (127.26.207.193:45331), 82f1488ae45a4bc1b3f85bb4e8ad42e4 (127.26.207.195:39973)
I20260808 23:33:57.152952 3486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5531dfc622ce489a85557c7c03b1288c" candidate_uuid: "d8caa041c5284b74b44d6546cad6c7fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" is_pre_election: true
I20260808 23:33:57.152956 3189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5531dfc622ce489a85557c7c03b1288c" candidate_uuid: "d8caa041c5284b74b44d6546cad6c7fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0fd7a69469d49b482d49c53c6a06c12" is_pre_election: true
I20260808 23:33:57.153260 3486 raft_consensus.cc:2454] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8caa041c5284b74b44d6546cad6c7fb in term 0.
I20260808 23:33:57.153263 3189 raft_consensus.cc:2454] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8caa041c5284b74b44d6546cad6c7fb in term 0.
I20260808 23:33:57.153802 3268 leader_election.cc:302] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f1488ae45a4bc1b3f85bb4e8ad42e4, d8caa041c5284b74b44d6546cad6c7fb; no voters:
I20260808 23:33:57.154155 3571 raft_consensus.cc:2781] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:33:57.154330 3571 raft_consensus.cc:482] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:33:57.154443 3571 raft_consensus.cc:3037] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:57.156953 3571 raft_consensus.cc:504] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.157697 3571 leader_election.cc:288] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [CANDIDATE]: Term 1 election: Requested vote from peers b0fd7a69469d49b482d49c53c6a06c12 (127.26.207.193:45331), 82f1488ae45a4bc1b3f85bb4e8ad42e4 (127.26.207.195:39973)
I20260808 23:33:57.158336 3189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5531dfc622ce489a85557c7c03b1288c" candidate_uuid: "d8caa041c5284b74b44d6546cad6c7fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0fd7a69469d49b482d49c53c6a06c12"
I20260808 23:33:57.158394 3486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5531dfc622ce489a85557c7c03b1288c" candidate_uuid: "d8caa041c5284b74b44d6546cad6c7fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4"
I20260808 23:33:57.158591 3189 raft_consensus.cc:3037] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:57.158692 3486 raft_consensus.cc:3037] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:57.161266 3189 raft_consensus.cc:2454] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8caa041c5284b74b44d6546cad6c7fb in term 1.
I20260808 23:33:57.162022 3267 leader_election.cc:302] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0fd7a69469d49b482d49c53c6a06c12, d8caa041c5284b74b44d6546cad6c7fb; no voters:
I20260808 23:33:57.162194 3486 raft_consensus.cc:2454] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8caa041c5284b74b44d6546cad6c7fb in term 1.
I20260808 23:33:57.162443 3571 raft_consensus.cc:2781] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:57.162715 3571 raft_consensus.cc:686] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [term 1 LEADER]: Becoming Leader. State: Replica: d8caa041c5284b74b44d6546cad6c7fb, State: Running, Role: LEADER
I20260808 23:33:57.163110 3571 consensus_queue.cc:237] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.170341 3025 catalog_manager.cc:5495] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb reported cstate change: term changed from 0 to 1, leader changed from <none> to d8caa041c5284b74b44d6546cad6c7fb (127.26.207.194). New cstate: current_term: 1 leader_uuid: "d8caa041c5284b74b44d6546cad6c7fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } health_report { overall_health: UNKNOWN } } }
Aug 08 23:33:57 dist-test-slave-1x4g krb5kdc[2977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232034, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.254@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM
I20260808 23:33:57.232096 3608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:57.215874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:45653 (local address 127.0.0.1:40432)
0808 23:33:57.216922 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:57.216941 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:57.217142 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:57.217498 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:57.217502 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:57.218276 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:33:57.218544 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:57.218555 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.219695 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.219701 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:57.220902 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:57.220916 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.221729 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.221734 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:57.221907 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:57.222762 (+ 855us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:33:57.222786 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:33:57.225619 (+ 2833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:33:57.229230 (+ 3611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:57.229250 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:57.229263 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:57.229770 (+ 507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:57.230187 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:33:57.230192 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:33:57.230196 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:33:57.230358 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:33:57.230929 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:33:57.230937 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:33:57.231124 (+ 187us) client_negotiation.cc:769] Sending connection context
0808 23:33:57.231297 (+ 173us) client_negotiation.cc:240] Negotiation successful
0808 23:33:57.231627 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":881,"thread_start_us":744,"threads_started":1}
I20260808 23:33:57.232136 3607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:57.215845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40432 (local address 127.26.207.254:45653)
0808 23:33:57.216725 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:57.216732 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:57.217053 (+ 321us) server_negotiation.cc:407] Connection header received
0808 23:33:57.217281 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:57.217292 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:57.217351 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:57.217486 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:57.218728 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.219544 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.221056 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.221541 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.221677 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:57.225871 (+ 4194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:57.225877 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:57.225880 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:57.225912 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:57.229052 (+ 3140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:57.229924 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:57.229931 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:57.229934 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:57.230064 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:57.230481 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:57.230487 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:57.230490 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:57.230780 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:57.230969 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:57.231391 (+ 422us) server_negotiation.cc:299] Negotiation successful
0808 23:33:57.231759 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":164,"server-negotiator.queue_time_us":681,"thread_start_us":480,"threads_started":1}
I20260808 23:33:57.239032 3025 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:40432:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 23:33:57.240243 3025 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:33:57.249215 3168 tablet_service.cc:1467] Processing CreateTablet for tablet bf947b107a8c4da89cff1419efbffba4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=78f3607f8d1f4f269f0925a11a2d2864]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 23:33:57.249861 3168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf947b107a8c4da89cff1419efbffba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:57.250051 3316 tablet_service.cc:1467] Processing CreateTablet for tablet bf947b107a8c4da89cff1419efbffba4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=78f3607f8d1f4f269f0925a11a2d2864]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 23:33:57.250581 3316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf947b107a8c4da89cff1419efbffba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:57.252882 3464 tablet_service.cc:1467] Processing CreateTablet for tablet bf947b107a8c4da89cff1419efbffba4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=78f3607f8d1f4f269f0925a11a2d2864]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 23:33:57.253531 3464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf947b107a8c4da89cff1419efbffba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:57.257844 3597 tablet_bootstrap.cc:492] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12: Bootstrap starting.
I20260808 23:33:57.258687 3595 tablet_bootstrap.cc:492] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb: Bootstrap starting.
I20260808 23:33:57.259793 3597 tablet_bootstrap.cc:654] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:57.260509 3595 tablet_bootstrap.cc:654] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:57.261436 3596 tablet_bootstrap.cc:492] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Bootstrap starting.
I20260808 23:33:57.263713 3596 tablet_bootstrap.cc:654] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:57.272433 3597 tablet_bootstrap.cc:492] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12: No bootstrap required, opened a new log
I20260808 23:33:57.272787 3597 ts_tablet_manager.cc:1397] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.011s
I20260808 23:33:57.273224 3596 tablet_bootstrap.cc:492] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: No bootstrap required, opened a new log
I20260808 23:33:57.273468 3596 ts_tablet_manager.cc:1397] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.006s
I20260808 23:33:57.274151 3597 raft_consensus.cc:348] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.274473 3597 raft_consensus.cc:374] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:57.274569 3597 raft_consensus.cc:729] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0fd7a69469d49b482d49c53c6a06c12, State: Initialized, Role: FOLLOWER
I20260808 23:33:57.274359 3596 raft_consensus.cc:348] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.274994 3596 raft_consensus.cc:374] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:57.274844 3597 consensus_queue.cc:260] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.275121 3595 tablet_bootstrap.cc:492] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb: No bootstrap required, opened a new log
I20260808 23:33:57.275152 3596 raft_consensus.cc:729] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f1488ae45a4bc1b3f85bb4e8ad42e4, State: Initialized, Role: FOLLOWER
I20260808 23:33:57.275509 3595 ts_tablet_manager.cc:1397] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.004s
I20260808 23:33:57.275375 3574 tablet_replica.cc:439] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } } }
I20260808 23:33:57.275483 3596 consensus_queue.cc:260] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.275743 3574 tablet_replica.cc:442] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:33:57.276007 3572 tablet_replica.cc:439] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } } }
I20260808 23:33:57.276458 3572 tablet_replica.cc:442] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:33:57.276355 3595 raft_consensus.cc:348] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.276684 3595 raft_consensus.cc:374] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:57.276839 3595 raft_consensus.cc:729] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8caa041c5284b74b44d6546cad6c7fb, State: Initialized, Role: FOLLOWER
I20260808 23:33:57.277092 3597 ts_tablet_manager.cc:1428] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260808 23:33:57.277168 3595 consensus_queue.cc:260] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.277761 3595 ts_tablet_manager.cc:1428] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 23:33:57.277803 3571 tablet_replica.cc:439] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } } }
I20260808 23:33:57.278190 3571 tablet_replica.cc:442] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:33:57.279629 3596 ts_tablet_manager.cc:1428] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260808 23:33:57.397861 3574 raft_consensus.cc:482] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:33:57.398157 3574 raft_consensus.cc:504] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.399816 3574 leader_election.cc:288] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8caa041c5284b74b44d6546cad6c7fb (127.26.207.194:34283), 82f1488ae45a4bc1b3f85bb4e8ad42e4 (127.26.207.195:39973)
I20260808 23:33:57.421506 3614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:57.400325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:48083 (local address 127.26.207.194:34283)
0808 23:33:57.412963 (+ 12638us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:57.412974 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:57.414117 (+ 1143us) server_negotiation.cc:407] Connection header received
0808 23:33:57.414329 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:57.414333 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:57.414398 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:57.414485 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:57.415091 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.416095 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.418777 (+ 2682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.420093 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.420434 (+ 341us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:57.420531 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:57.420968 (+ 437us) server_negotiation.cc:299] Negotiation successful
0808 23:33:57.421139 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12406,"thread_start_us":12263,"threads_started":1}
I20260808 23:33:57.421504 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:57.400337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:54429 (local address 127.26.207.195:39973)
0808 23:33:57.413731 (+ 13394us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:57.413738 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:57.413761 (+ 23us) server_negotiation.cc:407] Connection header received
0808 23:33:57.413843 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:57.413848 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:57.413932 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:57.414075 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:33:57.414728 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.415841 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.418778 (+ 2937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.420093 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.420290 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:57.420441 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:57.420989 (+ 548us) server_negotiation.cc:299] Negotiation successful
0808 23:33:57.421164 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13249,"thread_start_us":13132,"threads_started":1}
I20260808 23:33:57.421679 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:57.400179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:39973 (local address 127.26.207.193:54429)
0808 23:33:57.413369 (+ 13190us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:57.413403 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:57.413616 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:57.414128 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:57.414134 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:57.414157 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:57.414524 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:57.414537 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.416034 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.416039 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:57.418509 (+ 2470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:57.418532 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.420354 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.420368 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:57.420681 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:57.420806 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 23:33:57.420936 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 23:33:57.421116 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12944,"mutex_wait_us":186,"thread_start_us":12822,"threads_started":1}
I20260808 23:33:57.421998 3613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:57.400179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:34283 (local address 127.26.207.193:48083)
0808 23:33:57.413967 (+ 13788us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:57.413983 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:57.414142 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:57.414547 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:57.414551 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:57.414605 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:33:57.414917 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:57.414925 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.416241 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.416246 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:57.418509 (+ 2263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:57.418532 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.420354 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.420361 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:57.420686 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:57.420802 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 23:33:57.420920 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 23:33:57.421116 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13682,"mutex_wait_us":213,"thread_start_us":13635,"threads_started":1}
I20260808 23:33:57.422672 3486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf947b107a8c4da89cff1419efbffba4" candidate_uuid: "b0fd7a69469d49b482d49c53c6a06c12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" is_pre_election: true
I20260808 23:33:57.423041 3486 raft_consensus.cc:2454] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0fd7a69469d49b482d49c53c6a06c12 in term 0.
I20260808 23:33:57.422981 3337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf947b107a8c4da89cff1419efbffba4" candidate_uuid: "b0fd7a69469d49b482d49c53c6a06c12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8caa041c5284b74b44d6546cad6c7fb" is_pre_election: true
I20260808 23:33:57.423419 3337 raft_consensus.cc:2454] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0fd7a69469d49b482d49c53c6a06c12 in term 0.
I20260808 23:33:57.423717 3120 leader_election.cc:302] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f1488ae45a4bc1b3f85bb4e8ad42e4, b0fd7a69469d49b482d49c53c6a06c12; no voters:
I20260808 23:33:57.424193 3574 raft_consensus.cc:2781] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:33:57.424337 3574 raft_consensus.cc:482] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:33:57.424450 3574 raft_consensus.cc:3037] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:57.426846 3574 raft_consensus.cc:504] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.427590 3574 leader_election.cc:288] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [CANDIDATE]: Term 1 election: Requested vote from peers d8caa041c5284b74b44d6546cad6c7fb (127.26.207.194:34283), 82f1488ae45a4bc1b3f85bb4e8ad42e4 (127.26.207.195:39973)
I20260808 23:33:57.428275 3337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf947b107a8c4da89cff1419efbffba4" candidate_uuid: "b0fd7a69469d49b482d49c53c6a06c12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8caa041c5284b74b44d6546cad6c7fb"
I20260808 23:33:57.428254 3486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf947b107a8c4da89cff1419efbffba4" candidate_uuid: "b0fd7a69469d49b482d49c53c6a06c12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4"
I20260808 23:33:57.428514 3337 raft_consensus.cc:3037] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:57.428539 3486 raft_consensus.cc:3037] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:57.431697 3486 raft_consensus.cc:2454] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0fd7a69469d49b482d49c53c6a06c12 in term 1.
I20260808 23:33:57.431715 3337 raft_consensus.cc:2454] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0fd7a69469d49b482d49c53c6a06c12 in term 1.
I20260808 23:33:57.432341 3120 leader_election.cc:302] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f1488ae45a4bc1b3f85bb4e8ad42e4, b0fd7a69469d49b482d49c53c6a06c12; no voters:
I20260808 23:33:57.432756 3574 raft_consensus.cc:2781] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:57.433327 3574 raft_consensus.cc:686] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [term 1 LEADER]: Becoming Leader. State: Replica: b0fd7a69469d49b482d49c53c6a06c12, State: Running, Role: LEADER
I20260808 23:33:57.433823 3574 consensus_queue.cc:237] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.436141 3616 tablet_replica.cc:439] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12: TxnStatusTablet state changed. Reason: New leader b0fd7a69469d49b482d49c53c6a06c12. Latest consensus state: current_term: 1 leader_uuid: "b0fd7a69469d49b482d49c53c6a06c12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } } }
I20260808 23:33:57.436758 3616 tablet_replica.cc:442] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12: This TxnStatusTablet replica's current role is: LEADER
I20260808 23:33:57.437659 3618 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 23:33:57.437937 3618 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 23:33:57.438390 3025 catalog_manager.cc:5495] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0fd7a69469d49b482d49c53c6a06c12 (127.26.207.193). New cstate: current_term: 1 leader_uuid: "b0fd7a69469d49b482d49c53c6a06c12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260808 23:33:57.483942 3621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:57.474810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49544 (local address 127.26.207.193:45331)
0808 23:33:57.476058 (+ 1248us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:57.476064 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:57.476092 (+ 28us) server_negotiation.cc:407] Connection header received
0808 23:33:57.476190 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:57.476195 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:57.476305 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:57.476467 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:57.477124 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.478369 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.480459 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.481217 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.481352 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:57.482111 (+ 759us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:57.483069 (+ 958us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:57.483217 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:57.483442 (+ 225us) server_negotiation.cc:299] Negotiation successful
0808 23:33:57.483549 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1107,"thread_start_us":924,"threads_started":1}
I20260808 23:33:57.483942 3608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:57.474823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:45331 (local address 127.0.0.1:49544)
0808 23:33:57.475256 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:57.475288 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:57.475448 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:57.476580 (+ 1132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:57.476588 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:57.476624 (+ 36us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 23:33:57.476902 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:57.476916 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.478588 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.478597 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:57.480261 (+ 1664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:57.480281 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.481443 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.481452 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:57.481722 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:57.481819 (+ 97us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 23:33:57.483207 (+ 1388us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 23:33:57.483285 (+ 78us) client_negotiation.cc:769] Sending connection context
0808 23:33:57.483388 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 23:33:57.483590 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248}
I20260808 23:33:57.489537 3486 raft_consensus.cc:1261] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Refusing update from remote peer b0fd7a69469d49b482d49c53c6a06c12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:57.489807 3337 raft_consensus.cc:1261] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb [term 1 FOLLOWER]: Refusing update from remote peer b0fd7a69469d49b482d49c53c6a06c12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:57.490345 3616 consensus_queue.cc:1035] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:57.490711 3574 consensus_queue.cc:1035] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:57.501899 3572 tablet_replica.cc:439] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: TxnStatusTablet state changed. Reason: New leader b0fd7a69469d49b482d49c53c6a06c12. Latest consensus state: current_term: 1 leader_uuid: "b0fd7a69469d49b482d49c53c6a06c12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } } }
I20260808 23:33:57.502300 3572 tablet_replica.cc:442] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:33:57.505190 3616 tablet_replica.cc:439] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b0fd7a69469d49b482d49c53c6a06c12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } } }
I20260808 23:33:57.505519 3616 tablet_replica.cc:442] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12: This TxnStatusTablet replica's current role is: LEADER
I20260808 23:33:57.506693 3572 tablet_replica.cc:439] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b0fd7a69469d49b482d49c53c6a06c12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } } }
I20260808 23:33:57.506992 3572 tablet_replica.cc:442] T bf947b107a8c4da89cff1419efbffba4 P 82f1488ae45a4bc1b3f85bb4e8ad42e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:33:57.512121 3571 tablet_replica.cc:439] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb: TxnStatusTablet state changed. Reason: New leader b0fd7a69469d49b482d49c53c6a06c12. Latest consensus state: current_term: 1 leader_uuid: "b0fd7a69469d49b482d49c53c6a06c12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } } }
I20260808 23:33:57.512502 3571 tablet_replica.cc:442] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:33:57.512604 3574 tablet_replica.cc:439] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b0fd7a69469d49b482d49c53c6a06c12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } } }
I20260808 23:33:57.512948 3574 tablet_replica.cc:442] T bf947b107a8c4da89cff1419efbffba4 P b0fd7a69469d49b482d49c53c6a06c12: This TxnStatusTablet replica's current role is: LEADER
I20260808 23:33:57.526110 3571 tablet_replica.cc:439] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b0fd7a69469d49b482d49c53c6a06c12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } } }
I20260808 23:33:57.526468 3571 tablet_replica.cc:442] T bf947b107a8c4da89cff1419efbffba4 P d8caa041c5284b74b44d6546cad6c7fb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 23:33:57.542395 3621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:57.536089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:40177 (local address 127.26.207.193:45331)
0808 23:33:57.536272 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:57.536276 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:57.537075 (+ 799us) server_negotiation.cc:407] Connection header received
0808 23:33:57.537326 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:57.537332 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:57.537417 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:57.537525 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:57.538083 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.538855 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.540371 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.540927 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.541094 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:57.541593 (+ 499us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:57.541710 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:57.541827 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:57.541976 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 23:33:57.542063 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 23:33:57.542528 3633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:57.536055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:45331 (local address 127.26.207.194:40177)
0808 23:33:57.536959 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:57.536976 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:57.537162 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:57.537542 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:57.537547 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:57.537559 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 23:33:57.537914 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:57.537924 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.539025 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.539031 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:57.540203 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:57.540216 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.541138 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.541147 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:57.541310 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:57.541375 (+ 65us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 23:33:57.541828 (+ 453us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 23:33:57.541842 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 23:33:57.541949 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 23:33:57.542103 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":437,"threads_started":1}
I20260808 23:33:57.554801 3486 raft_consensus.cc:1261] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Refusing update from remote peer d8caa041c5284b74b44d6546cad6c7fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:57.554801 3189 raft_consensus.cc:1261] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Refusing update from remote peer d8caa041c5284b74b44d6546cad6c7fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:57.555503 3571 consensus_queue.cc:1035] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:57.555842 3577 consensus_queue.cc:1035] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:57.605360 3614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:57.597524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:50123 (local address 127.26.207.194:34283)
0808 23:33:57.597728 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:57.597737 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:57.598471 (+ 734us) server_negotiation.cc:407] Connection header received
0808 23:33:57.598659 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:57.598665 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:57.598757 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:57.598865 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:57.599726 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.600842 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.603039 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.603739 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.603879 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:57.604500 (+ 621us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:57.604613 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:57.604753 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:57.604941 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 23:33:57.605038 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 23:33:57.605681 3639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:57.597525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:34283 (local address 127.26.207.193:50123)
0808 23:33:57.598341 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:57.598358 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:57.598489 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:57.598933 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:57.598939 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:57.598952 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 23:33:57.599418 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:57.599482 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.601407 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.601412 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:57.602869 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:57.602885 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.603978 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.603986 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:57.604188 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:57.604275 (+ 87us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 23:33:57.604763 (+ 488us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 23:33:57.604807 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 23:33:57.604899 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 23:33:57.605078 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":427,"threads_started":1}
I20260808 23:33:57.646349 3024 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:57.646661 3024 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:57.650583 3024 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b: Sending DeleteTablet for 3 replicas of tablet 5531dfc622ce489a85557c7c03b1288c
I20260808 23:33:57.651738 3316 tablet_service.cc:1514] Processing DeleteTablet for tablet 5531dfc622ce489a85557c7c03b1288c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:57 UTC) from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:47388
I20260808 23:33:57.651728 3464 tablet_service.cc:1514] Processing DeleteTablet for tablet 5531dfc622ce489a85557c7c03b1288c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:57 UTC) from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:42046
I20260808 23:33:57.652329 3168 tablet_service.cc:1514] Processing DeleteTablet for tablet 5531dfc622ce489a85557c7c03b1288c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:57 UTC) from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:49532
I20260808 23:33:57.652827 3642 tablet_replica.cc:330] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: stopping tablet replica
I20260808 23:33:57.653250 3642 raft_consensus.cc:2229] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:57.653821 3642 raft_consensus.cc:2258] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:57.655622 3642 ts_tablet_manager.cc:1905] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:57.662719 3643 tablet_replica.cc:330] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12: stopping tablet replica
I20260808 23:33:57.663010 3643 raft_consensus.cc:2229] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:57.663309 3643 raft_consensus.cc:2258] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:57.665302 3641 tablet_replica.cc:330] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb: stopping tablet replica
I20260808 23:33:57.665537 3641 raft_consensus.cc:2229] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:33:57.664727 3643 ts_tablet_manager.cc:1905] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:57.667296 3641 raft_consensus.cc:2258] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:57.668546 3641 ts_tablet_manager.cc:1905] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:57.669348 3642 ts_tablet_manager.cc:1918] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 23:33:57.669597 3642 log.cc:1196] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/5531dfc622ce489a85557c7c03b1288c
I20260808 23:33:57.670202 3642 ts_tablet_manager.cc:1939] T 5531dfc622ce489a85557c7c03b1288c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Deleting consensus metadata
I20260808 23:33:57.671733 3011 catalog_manager.cc:4841] TS 82f1488ae45a4bc1b3f85bb4e8ad42e4 (127.26.207.195:39973): tablet 5531dfc622ce489a85557c7c03b1288c (table test-table [id=316bc094c82a417e8bd9a604f160b6f4]) successfully deleted
I20260808 23:33:57.677127 3641 ts_tablet_manager.cc:1918] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 23:33:57.677322 3641 log.cc:1196] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/5531dfc622ce489a85557c7c03b1288c
I20260808 23:33:57.677820 3641 ts_tablet_manager.cc:1939] T 5531dfc622ce489a85557c7c03b1288c P d8caa041c5284b74b44d6546cad6c7fb: Deleting consensus metadata
I20260808 23:33:57.679313 3010 catalog_manager.cc:4841] TS d8caa041c5284b74b44d6546cad6c7fb (127.26.207.194:34283): tablet 5531dfc622ce489a85557c7c03b1288c (table test-table [id=316bc094c82a417e8bd9a604f160b6f4]) successfully deleted
I20260808 23:33:57.680330 3643 ts_tablet_manager.cc:1918] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 23:33:57.680503 3643 log.cc:1196] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/5531dfc622ce489a85557c7c03b1288c
I20260808 23:33:57.681115 3643 ts_tablet_manager.cc:1939] T 5531dfc622ce489a85557c7c03b1288c P b0fd7a69469d49b482d49c53c6a06c12: Deleting consensus metadata
I20260808 23:33:57.682490 3010 catalog_manager.cc:4841] TS b0fd7a69469d49b482d49c53c6a06c12 (127.26.207.193:45331): tablet 5531dfc622ce489a85557c7c03b1288c (table test-table [id=316bc094c82a417e8bd9a604f160b6f4]) successfully deleted
Aug 08 23:33:57 dist-test-slave-1x4g krb5kdc[2977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 23:33:57 dist-test-slave-1x4g krb5kdc[2977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:33:57 dist-test-slave-1x4g krb5kdc[2977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 23:33:57.732513 3607 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:33:57.719483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40438 (local address 127.26.207.254:45653)
0808 23:33:57.719764 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:57.719771 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:57.720129 (+ 358us) server_negotiation.cc:407] Connection header received
0808 23:33:57.720398 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:57.720403 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:57.720476 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:57.720578 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:57.722605 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.723392 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.725342 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.725808 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.725925 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:57.732227 (+ 6302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40438: BlockingRecv error: recv got EOF from 127.0.0.1:40438 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 08 23:33:57 dist-test-slave-1x4g krb5kdc[2977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM
I20260808 23:33:57.755079 3607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:57.736881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40452 (local address 127.26.207.254:45653)
0808 23:33:57.737115 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:57.737124 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:57.737651 (+ 527us) server_negotiation.cc:407] Connection header received
0808 23:33:57.737865 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:57.737870 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:57.737959 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:57.738083 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:57.739452 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.740248 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.741721 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.742179 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.742338 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:57.747678 (+ 5340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:57.747685 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:57.747688 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:57.747736 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:57.751572 (+ 3836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:57.752547 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:57.752558 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:57.752561 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:57.752849 (+ 288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:57.753349 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:57.753354 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:57.753358 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:57.753755 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:57.754131 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:57.754425 (+ 294us) server_negotiation.cc:299] Negotiation successful
0808 23:33:57.754700 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 23:33:57.759666 3024 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40452:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:33:57.760555 3024 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:33:57.769690 3316 tablet_service.cc:1467] Processing CreateTablet for tablet f9c190ce7cab41ec99eb340201f30cbe (DEFAULT_TABLE table=test-table [id=e9a9cdd499a74ea59b613f5141a0def8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:57.769639 3168 tablet_service.cc:1467] Processing CreateTablet for tablet f9c190ce7cab41ec99eb340201f30cbe (DEFAULT_TABLE table=test-table [id=e9a9cdd499a74ea59b613f5141a0def8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:57.770306 3168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9c190ce7cab41ec99eb340201f30cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:57.770326 3316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9c190ce7cab41ec99eb340201f30cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:57.773999 3464 tablet_service.cc:1467] Processing CreateTablet for tablet f9c190ce7cab41ec99eb340201f30cbe (DEFAULT_TABLE table=test-table [id=e9a9cdd499a74ea59b613f5141a0def8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:57.774513 3464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9c190ce7cab41ec99eb340201f30cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:57.777163 3595 tablet_bootstrap.cc:492] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb: Bootstrap starting.
I20260808 23:33:57.779031 3595 tablet_bootstrap.cc:654] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:57.780309 3597 tablet_bootstrap.cc:492] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12: Bootstrap starting.
I20260808 23:33:57.782747 3597 tablet_bootstrap.cc:654] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:57.784719 3657 tablet_bootstrap.cc:492] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Bootstrap starting.
I20260808 23:33:57.786777 3657 tablet_bootstrap.cc:654] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:57.787406 3595 tablet_bootstrap.cc:492] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb: No bootstrap required, opened a new log
I20260808 23:33:57.787606 3595 ts_tablet_manager.cc:1397] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.003s
I20260808 23:33:57.788749 3595 raft_consensus.cc:348] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.791553 3595 raft_consensus.cc:374] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:57.791733 3595 raft_consensus.cc:729] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8caa041c5284b74b44d6546cad6c7fb, State: Initialized, Role: FOLLOWER
I20260808 23:33:57.792172 3595 consensus_queue.cc:260] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.798859 3595 ts_tablet_manager.cc:1428] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb: Time spent starting tablet: real 0.011s user 0.000s sys 0.004s
I20260808 23:33:57.805752 3657 tablet_bootstrap.cc:492] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4: No bootstrap required, opened a new log
I20260808 23:33:57.805929 3597 tablet_bootstrap.cc:492] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12: No bootstrap required, opened a new log
I20260808 23:33:57.806007 3657 ts_tablet_manager.cc:1397] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Time spent bootstrapping tablet: real 0.021s user 0.016s sys 0.004s
I20260808 23:33:57.806164 3597 ts_tablet_manager.cc:1397] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12: Time spent bootstrapping tablet: real 0.026s user 0.012s sys 0.011s
I20260808 23:33:57.806857 3657 raft_consensus.cc:348] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.807144 3657 raft_consensus.cc:374] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:57.807248 3657 raft_consensus.cc:729] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f1488ae45a4bc1b3f85bb4e8ad42e4, State: Initialized, Role: FOLLOWER
I20260808 23:33:57.807142 3597 raft_consensus.cc:348] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.807444 3597 raft_consensus.cc:374] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:57.807565 3597 raft_consensus.cc:729] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0fd7a69469d49b482d49c53c6a06c12, State: Initialized, Role: FOLLOWER
I20260808 23:33:57.807610 3657 consensus_queue.cc:260] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.808327 3657 ts_tablet_manager.cc:1428] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 23:33:57.807823 3597 consensus_queue.cc:260] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.810078 3597 ts_tablet_manager.cc:1428] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260808 23:33:57.867599 3636 raft_consensus.cc:482] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:33:57.867869 3636 raft_consensus.cc:504] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.868909 3636 leader_election.cc:288] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0fd7a69469d49b482d49c53c6a06c12 (127.26.207.193:45331), 82f1488ae45a4bc1b3f85bb4e8ad42e4 (127.26.207.195:39973)
I20260808 23:33:57.869848 3189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9c190ce7cab41ec99eb340201f30cbe" candidate_uuid: "d8caa041c5284b74b44d6546cad6c7fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0fd7a69469d49b482d49c53c6a06c12" is_pre_election: true
I20260808 23:33:57.869853 3486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9c190ce7cab41ec99eb340201f30cbe" candidate_uuid: "d8caa041c5284b74b44d6546cad6c7fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" is_pre_election: true
I20260808 23:33:57.870134 3486 raft_consensus.cc:2454] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8caa041c5284b74b44d6546cad6c7fb in term 0.
I20260808 23:33:57.870152 3189 raft_consensus.cc:2454] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8caa041c5284b74b44d6546cad6c7fb in term 0.
I20260808 23:33:57.870653 3268 leader_election.cc:302] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f1488ae45a4bc1b3f85bb4e8ad42e4, d8caa041c5284b74b44d6546cad6c7fb; no voters:
I20260808 23:33:57.870985 3636 raft_consensus.cc:2781] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:33:57.871125 3636 raft_consensus.cc:482] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:33:57.871236 3636 raft_consensus.cc:3037] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:57.874691 3636 raft_consensus.cc:504] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.875532 3636 leader_election.cc:288] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [CANDIDATE]: Term 1 election: Requested vote from peers b0fd7a69469d49b482d49c53c6a06c12 (127.26.207.193:45331), 82f1488ae45a4bc1b3f85bb4e8ad42e4 (127.26.207.195:39973)
I20260808 23:33:57.876200 3486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9c190ce7cab41ec99eb340201f30cbe" candidate_uuid: "d8caa041c5284b74b44d6546cad6c7fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4"
I20260808 23:33:57.876277 3189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9c190ce7cab41ec99eb340201f30cbe" candidate_uuid: "d8caa041c5284b74b44d6546cad6c7fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0fd7a69469d49b482d49c53c6a06c12"
I20260808 23:33:57.876459 3486 raft_consensus.cc:3037] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:57.876528 3189 raft_consensus.cc:3037] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:57.878748 3486 raft_consensus.cc:2454] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8caa041c5284b74b44d6546cad6c7fb in term 1.
I20260808 23:33:57.879330 3268 leader_election.cc:302] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f1488ae45a4bc1b3f85bb4e8ad42e4, d8caa041c5284b74b44d6546cad6c7fb; no voters:
I20260808 23:33:57.879686 3636 raft_consensus.cc:2781] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:57.879901 3636 raft_consensus.cc:686] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [term 1 LEADER]: Becoming Leader. State: Replica: d8caa041c5284b74b44d6546cad6c7fb, State: Running, Role: LEADER
I20260808 23:33:57.880086 3189 raft_consensus.cc:2454] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8caa041c5284b74b44d6546cad6c7fb in term 1.
I20260808 23:33:57.880205 3636 consensus_queue.cc:237] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.883765 3024 catalog_manager.cc:5495] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb reported cstate change: term changed from 0 to 1, leader changed from <none> to d8caa041c5284b74b44d6546cad6c7fb (127.26.207.194). New cstate: current_term: 1 leader_uuid: "d8caa041c5284b74b44d6546cad6c7fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260808 23:33:57.901377 3614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:57.895535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47396 (local address 127.26.207.194:34283)
0808 23:33:57.895759 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:57.895765 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:57.895911 (+ 146us) server_negotiation.cc:407] Connection header received
0808 23:33:57.896200 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:57.896205 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:57.896296 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:57.896421 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:57.896939 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.897736 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.899228 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:57.899767 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:57.899930 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:57.900439 (+ 509us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:57.900611 (+ 172us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:57.900716 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:57.900952 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 23:33:57.901068 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 23:33:57.904613 3486 raft_consensus.cc:1261] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Refusing update from remote peer d8caa041c5284b74b44d6546cad6c7fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:57.904706 3189 raft_consensus.cc:1261] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Refusing update from remote peer d8caa041c5284b74b44d6546cad6c7fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:57.905670 3636 consensus_queue.cc:1035] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:57.906333 3577 consensus_queue.cc:1035] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:57.917954 3024 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:57.918252 3024 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:57.923409 3464 tablet_service.cc:1514] Processing DeleteTablet for tablet f9c190ce7cab41ec99eb340201f30cbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:57 UTC) from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:42046
I20260808 23:33:57.923568 3024 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b: Sending DeleteTablet for 3 replicas of tablet f9c190ce7cab41ec99eb340201f30cbe
I20260808 23:33:57.923887 3642 tablet_replica.cc:330] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4: stopping tablet replica
I20260808 23:33:57.924149 3642 raft_consensus.cc:2229] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:57.924398 3642 raft_consensus.cc:2258] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:57.924500 3168 tablet_service.cc:1514] Processing DeleteTablet for tablet f9c190ce7cab41ec99eb340201f30cbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:57 UTC) from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:49532
I20260808 23:33:57.924737 3316 tablet_service.cc:1514] Processing DeleteTablet for tablet f9c190ce7cab41ec99eb340201f30cbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:57 UTC) from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:47388
I20260808 23:33:57.924844 3643 tablet_replica.cc:330] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12: stopping tablet replica
I20260808 23:33:57.925083 3641 tablet_replica.cc:330] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb: stopping tablet replica
I20260808 23:33:57.925062 3643 raft_consensus.cc:2229] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:57.925294 3641 raft_consensus.cc:2229] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:33:57.925288 3643 pending_rounds.cc:62] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12: Trying to abort 2 pending ops.
I20260808 23:33:57.925674 3641 raft_consensus.cc:2258] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:57.925531 3643 pending_rounds.cc:68] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316406427250249728 op_type: WRITE_OP write_request { tablet_id: "f9c190ce7cab41ec99eb340201f30cbe" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\221\374\336\323\006\"8\n\ntest-admin\022*\n e9a9cdd499a74ea59b613f5141a0def8\020\001\030\001 \001(\001" signature: "<redacted>""\204\272\324F\336jlk\017\234\237\257N:I\r5FWn5\217\021\247\200\271\276\305\031\301%\203\017i`[>\'$0\370\343V\0227\252\t\371\007\313V@73\320\330\017{A\317`O\317\027" signing_key_seq_num: 0 } } request_id { client_id: "a9a9f9fd0c174718a10a5a7a0abc38b4" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260808 23:33:57.926504 3643 pending_rounds.cc:68] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316406427160731648 op_type: NO_OP noop_request { }
I20260808 23:33:57.926715 3643 raft_consensus.cc:2866] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260808 23:33:57.926826 3464 tablet_service.cc:1514] Processing DeleteTablet for tablet f9c190ce7cab41ec99eb340201f30cbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:57 UTC) from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:42046
I20260808 23:33:57.926908 3643 raft_consensus.cc:2258] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:57.928094 3643 ts_tablet_manager.cc:1905] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:57.928094 3641 ts_tablet_manager.cc:1905] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:57.929692 3024 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40452:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:33:57.930534 3024 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:33:57.933849 3642 ts_tablet_manager.cc:1905] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:57.935843 3643 ts_tablet_manager.cc:1918] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:57.936072 3643 log.cc:1196] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/f9c190ce7cab41ec99eb340201f30cbe
I20260808 23:33:57.936650 3643 ts_tablet_manager.cc:1939] T f9c190ce7cab41ec99eb340201f30cbe P b0fd7a69469d49b482d49c53c6a06c12: Deleting consensus metadata
I20260808 23:33:57.937727 3010 catalog_manager.cc:4841] TS b0fd7a69469d49b482d49c53c6a06c12 (127.26.207.193:45331): tablet f9c190ce7cab41ec99eb340201f30cbe (table test-table [id=e9a9cdd499a74ea59b613f5141a0def8]) successfully deleted
I20260808 23:33:57.939281 3641 ts_tablet_manager.cc:1918] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:57.939787 3641 log.cc:1196] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/f9c190ce7cab41ec99eb340201f30cbe
I20260808 23:33:57.940444 3641 ts_tablet_manager.cc:1939] T f9c190ce7cab41ec99eb340201f30cbe P d8caa041c5284b74b44d6546cad6c7fb: Deleting consensus metadata
I20260808 23:33:57.941732 3168 tablet_service.cc:1467] Processing CreateTablet for tablet f848d0fd918949deadd754c7e651ad5c (DEFAULT_TABLE table=test-table [id=374c665df97e4933a7ce80a64ea9fd39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:57.941713 3464 tablet_service.cc:1467] Processing CreateTablet for tablet f848d0fd918949deadd754c7e651ad5c (DEFAULT_TABLE table=test-table [id=374c665df97e4933a7ce80a64ea9fd39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:57.942184 3464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f848d0fd918949deadd754c7e651ad5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:57.942198 3168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f848d0fd918949deadd754c7e651ad5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:57.945297 3316 tablet_service.cc:1467] Processing CreateTablet for tablet f848d0fd918949deadd754c7e651ad5c (DEFAULT_TABLE table=test-table [id=374c665df97e4933a7ce80a64ea9fd39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:33:57.945776 3316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f848d0fd918949deadd754c7e651ad5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:33:57.948200 3010 catalog_manager.cc:4841] TS d8caa041c5284b74b44d6546cad6c7fb (127.26.207.194:34283): tablet f9c190ce7cab41ec99eb340201f30cbe (table test-table [id=e9a9cdd499a74ea59b613f5141a0def8]) successfully deleted
I20260808 23:33:57.948994 3597 tablet_bootstrap.cc:492] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12: Bootstrap starting.
I20260808 23:33:57.949904 3642 ts_tablet_manager.cc:1918] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:33:57.950158 3642 log.cc:1196] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/f9c190ce7cab41ec99eb340201f30cbe
I20260808 23:33:57.950919 3642 ts_tablet_manager.cc:1939] T f9c190ce7cab41ec99eb340201f30cbe P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Deleting consensus metadata
I20260808 23:33:57.951166 3597 tablet_bootstrap.cc:654] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12: Neither blocks nor log segments found. Creating new log.
W20260808 23:33:57.954603 3011 catalog_manager.cc:4808] TS 82f1488ae45a4bc1b3f85bb4e8ad42e4 (127.26.207.195:39973): delete failed for tablet f9c190ce7cab41ec99eb340201f30cbe because the tablet was not found. No further retry: Not found: Tablet not found: f9c190ce7cab41ec99eb340201f30cbe
I20260808 23:33:57.956054 3657 tablet_bootstrap.cc:492] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Bootstrap starting.
I20260808 23:33:57.957917 3657 tablet_bootstrap.cc:654] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:57.959553 3595 tablet_bootstrap.cc:492] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb: Bootstrap starting.
I20260808 23:33:57.961524 3597 tablet_bootstrap.cc:492] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12: No bootstrap required, opened a new log
I20260808 23:33:57.961839 3597 ts_tablet_manager.cc:1397] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.003s
I20260808 23:33:57.961920 3595 tablet_bootstrap.cc:654] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb: Neither blocks nor log segments found. Creating new log.
I20260808 23:33:57.962910 3597 raft_consensus.cc:348] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.963397 3597 raft_consensus.cc:374] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:57.963562 3597 raft_consensus.cc:729] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0fd7a69469d49b482d49c53c6a06c12, State: Initialized, Role: FOLLOWER
I20260808 23:33:57.964021 3597 consensus_queue.cc:260] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.965243 3597 ts_tablet_manager.cc:1428] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 23:33:57.973240 3657 tablet_bootstrap.cc:492] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: No bootstrap required, opened a new log
I20260808 23:33:57.973495 3657 ts_tablet_manager.cc:1397] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.010s
I20260808 23:33:57.974363 3595 tablet_bootstrap.cc:492] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb: No bootstrap required, opened a new log
I20260808 23:33:57.974440 3657 raft_consensus.cc:348] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.974684 3595 ts_tablet_manager.cc:1397] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.011s
I20260808 23:33:57.974750 3657 raft_consensus.cc:374] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:57.974839 3657 raft_consensus.cc:729] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f1488ae45a4bc1b3f85bb4e8ad42e4, State: Initialized, Role: FOLLOWER
I20260808 23:33:57.975116 3657 consensus_queue.cc:260] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.975721 3657 ts_tablet_manager.cc:1428] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 23:33:57.975576 3595 raft_consensus.cc:348] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.975848 3595 raft_consensus.cc:374] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:33:57.975945 3595 raft_consensus.cc:729] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8caa041c5284b74b44d6546cad6c7fb, State: Initialized, Role: FOLLOWER
I20260808 23:33:57.976246 3595 consensus_queue.cc:260] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:57.976902 3595 ts_tablet_manager.cc:1428] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260808 23:33:58.054960 3616 raft_consensus.cc:482] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:33:58.055188 3616 raft_consensus.cc:504] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:58.055825 3616 leader_election.cc:288] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8caa041c5284b74b44d6546cad6c7fb (127.26.207.194:34283), 82f1488ae45a4bc1b3f85bb4e8ad42e4 (127.26.207.195:39973)
I20260808 23:33:58.056564 3336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f848d0fd918949deadd754c7e651ad5c" candidate_uuid: "b0fd7a69469d49b482d49c53c6a06c12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8caa041c5284b74b44d6546cad6c7fb" is_pre_election: true
I20260808 23:33:58.056632 3486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f848d0fd918949deadd754c7e651ad5c" candidate_uuid: "b0fd7a69469d49b482d49c53c6a06c12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" is_pre_election: true
I20260808 23:33:58.056905 3336 raft_consensus.cc:2454] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0fd7a69469d49b482d49c53c6a06c12 in term 0.
I20260808 23:33:58.056953 3486 raft_consensus.cc:2454] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0fd7a69469d49b482d49c53c6a06c12 in term 0.
I20260808 23:33:58.057494 3119 leader_election.cc:302] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 82f1488ae45a4bc1b3f85bb4e8ad42e4, b0fd7a69469d49b482d49c53c6a06c12, d8caa041c5284b74b44d6546cad6c7fb; no voters:
I20260808 23:33:58.057898 3616 raft_consensus.cc:2781] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:33:58.058022 3616 raft_consensus.cc:482] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:33:58.058143 3616 raft_consensus.cc:3037] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:58.060310 3616 raft_consensus.cc:504] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:58.061085 3616 leader_election.cc:288] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [CANDIDATE]: Term 1 election: Requested vote from peers d8caa041c5284b74b44d6546cad6c7fb (127.26.207.194:34283), 82f1488ae45a4bc1b3f85bb4e8ad42e4 (127.26.207.195:39973)
I20260808 23:33:58.061666 3336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f848d0fd918949deadd754c7e651ad5c" candidate_uuid: "b0fd7a69469d49b482d49c53c6a06c12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8caa041c5284b74b44d6546cad6c7fb"
I20260808 23:33:58.061674 3486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f848d0fd918949deadd754c7e651ad5c" candidate_uuid: "b0fd7a69469d49b482d49c53c6a06c12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4"
I20260808 23:33:58.061903 3486 raft_consensus.cc:3037] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:58.061903 3336 raft_consensus.cc:3037] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:33:58.065146 3336 raft_consensus.cc:2454] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0fd7a69469d49b482d49c53c6a06c12 in term 1.
I20260808 23:33:58.065147 3486 raft_consensus.cc:2454] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0fd7a69469d49b482d49c53c6a06c12 in term 1.
I20260808 23:33:58.065603 3120 leader_election.cc:302] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f1488ae45a4bc1b3f85bb4e8ad42e4, b0fd7a69469d49b482d49c53c6a06c12; no voters:
I20260808 23:33:58.065930 3616 raft_consensus.cc:2781] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:33:58.066144 3616 raft_consensus.cc:686] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [term 1 LEADER]: Becoming Leader. State: Replica: b0fd7a69469d49b482d49c53c6a06c12, State: Running, Role: LEADER
I20260808 23:33:58.066414 3616 consensus_queue.cc:237] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } }
I20260808 23:33:58.069216 3025 catalog_manager.cc:5495] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0fd7a69469d49b482d49c53c6a06c12 (127.26.207.193). New cstate: current_term: 1 leader_uuid: "b0fd7a69469d49b482d49c53c6a06c12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fd7a69469d49b482d49c53c6a06c12" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 45331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260808 23:33:58.118132 3668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:58.111790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49554 (local address 127.26.207.193:45331)
0808 23:33:58.112339 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:58.112345 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:58.112364 (+ 19us) server_negotiation.cc:407] Connection header received
0808 23:33:58.112441 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:58.112446 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:58.112530 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:58.112642 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:58.113219 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:58.114321 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:58.115865 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:58.116549 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:58.116702 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:58.117306 (+ 604us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:58.117469 (+ 163us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:58.117560 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:58.117727 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 23:33:58.117814 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":289,"threads_started":1}
I20260808 23:33:58.133085 3668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:58.127554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:54653 (local address 127.26.207.193:45331)
0808 23:33:58.127825 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:58.127837 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:58.128163 (+ 326us) server_negotiation.cc:407] Connection header received
0808 23:33:58.128369 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:58.128374 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:58.128440 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:58.128537 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:33:58.129049 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:58.129848 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:58.131239 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:58.131635 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:58.131813 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:58.132274 (+ 461us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:33:58.132375 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:33:58.132478 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:58.132619 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 23:33:58.132713 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":95}
I20260808 23:33:58.133140 3673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:58.127353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:45331 (local address 127.26.207.193:54653)
0808 23:33:58.128032 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0808 23:33:58.128048 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 23:33:58.128240 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:33:58.128561 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:33:58.128565 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:33:58.128575 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 23:33:58.128908 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:58.128919 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:58.129991 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:58.129999 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:58.131069 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:33:58.131092 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:33:58.131822 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:33:58.131829 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:33:58.132027 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:58.132063 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 23:33:58.132478 (+ 415us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 23:33:58.132490 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 23:33:58.132599 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 23:33:58.132752 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"mutex_wait_us":51,"thread_start_us":383,"threads_started":1}
I20260808 23:33:58.141465 3486 raft_consensus.cc:1261] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Refusing update from remote peer b0fd7a69469d49b482d49c53c6a06c12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:58.141716 3336 raft_consensus.cc:1261] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb [term 1 FOLLOWER]: Refusing update from remote peer b0fd7a69469d49b482d49c53c6a06c12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:33:58.142068 3574 consensus_queue.cc:1035] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f1488ae45a4bc1b3f85bb4e8ad42e4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:58.142985 3574 consensus_queue.cc:1035] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8caa041c5284b74b44d6546cad6c7fb" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:33:58.210500 3024 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:58.210860 3024 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:33:58.214738 3024 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4b512c42959f4c4aad36e270598e4d7b: Sending DeleteTablet for 3 replicas of tablet f848d0fd918949deadd754c7e651ad5c
I20260808 23:33:58.215886 3168 tablet_service.cc:1514] Processing DeleteTablet for tablet f848d0fd918949deadd754c7e651ad5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:58 UTC) from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:49532
I20260808 23:33:58.216286 3643 tablet_replica.cc:330] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12: stopping tablet replica
I20260808 23:33:58.216282 3316 tablet_service.cc:1514] Processing DeleteTablet for tablet f848d0fd918949deadd754c7e651ad5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:58 UTC) from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:47388
I20260808 23:33:58.216423 3464 tablet_service.cc:1514] Processing DeleteTablet for tablet f848d0fd918949deadd754c7e651ad5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:33:58 UTC) from {username='oryx', principal='oryx/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:42046
I20260808 23:33:58.216526 3643 raft_consensus.cc:2229] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:33:58.216645 3641 tablet_replica.cc:330] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb: stopping tablet replica
I20260808 23:33:58.216794 3642 tablet_replica.cc:330] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: stopping tablet replica
I20260808 23:33:58.216856 3641 raft_consensus.cc:2229] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:58.216992 3642 raft_consensus.cc:2229] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:33:58.217051 3641 raft_consensus.cc:2258] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:58.217211 3642 raft_consensus.cc:2258] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:58.217212 3643 raft_consensus.cc:2258] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:33:58.218251 3641 ts_tablet_manager.cc:1905] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:58.218538 3643 ts_tablet_manager.cc:1905] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:58.218876 3642 ts_tablet_manager.cc:1905] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:33:58.225783 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 3101
I20260808 23:33:58.226502 3643 ts_tablet_manager.cc:1918] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 23:33:58.227088 3643 log.cc:1196] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/f848d0fd918949deadd754c7e651ad5c
I20260808 23:33:58.227699 3643 ts_tablet_manager.cc:1939] T f848d0fd918949deadd754c7e651ad5c P b0fd7a69469d49b482d49c53c6a06c12: Deleting consensus metadata
I20260808 23:33:58.228735 3642 ts_tablet_manager.cc:1918] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 23:33:58.228935 3642 log.cc:1196] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/f848d0fd918949deadd754c7e651ad5c
I20260808 23:33:58.229094 3010 catalog_manager.cc:4841] TS b0fd7a69469d49b482d49c53c6a06c12 (127.26.207.193:45331): tablet f848d0fd918949deadd754c7e651ad5c (table test-table [id=374c665df97e4933a7ce80a64ea9fd39]) successfully deleted
I20260808 23:33:58.229410 3642 ts_tablet_manager.cc:1939] T f848d0fd918949deadd754c7e651ad5c P 82f1488ae45a4bc1b3f85bb4e8ad42e4: Deleting consensus metadata
I20260808 23:33:58.230006 3641 ts_tablet_manager.cc:1918] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 23:33:58.230189 3641 log.cc:1196] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/f848d0fd918949deadd754c7e651ad5c
I20260808 23:33:58.230683 3641 ts_tablet_manager.cc:1939] T f848d0fd918949deadd754c7e651ad5c P d8caa041c5284b74b44d6546cad6c7fb: Deleting consensus metadata
I20260808 23:33:58.230654 3011 catalog_manager.cc:4841] TS 82f1488ae45a4bc1b3f85bb4e8ad42e4 (127.26.207.195:39973): tablet f848d0fd918949deadd754c7e651ad5c (table test-table [id=374c665df97e4933a7ce80a64ea9fd39]) successfully deleted
I20260808 23:33:58.231941 3010 catalog_manager.cc:4841] TS d8caa041c5284b74b44d6546cad6c7fb (127.26.207.194:34283): tablet f848d0fd918949deadd754c7e651ad5c (table test-table [id=374c665df97e4933a7ce80a64ea9fd39]) successfully deleted
Aug 08 23:33:58 dist-test-slave-1x4g krb5kdc[2977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.207.193@KRBTEST.COM
I20260808 23:33:58.248356 3668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:58.227470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49556 (local address 127.26.207.193:45331)
0808 23:33:58.229764 (+ 2294us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:58.229770 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:58.229795 (+ 25us) server_negotiation.cc:407] Connection header received
0808 23:33:58.230062 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:58.230068 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:58.230302 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:58.230416 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:58.232227 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:58.233122 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:58.234448 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:58.234901 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:58.235058 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:58.240101 (+ 5043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:58.240119 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:58.240136 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:58.240177 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:58.244592 (+ 4415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:58.245569 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:58.245578 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:58.245580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:58.245805 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:58.246335 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:58.246340 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:58.246343 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:58.246778 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:58.247195 (+ 417us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:58.247645 (+ 450us) server_negotiation.cc:299] Negotiation successful
0808 23:33:58.247914 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2148}
I20260808 23:33:58.249403 3238 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:58.404155 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 3101
I20260808 23:33:58.435431 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 3249
Aug 08 23:33:58 dist-test-slave-1x4g krb5kdc[2977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.207.194@KRBTEST.COM
I20260808 23:33:58.454352 3680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:58.436569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47412 (local address 127.26.207.194:34283)
0808 23:33:58.437219 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:58.437228 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:58.437254 (+ 26us) server_negotiation.cc:407] Connection header received
0808 23:33:58.437328 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:58.437332 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:58.437406 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:58.437556 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:58.438860 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:58.439597 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:58.441310 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:58.441921 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:58.442070 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:58.447340 (+ 5270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:58.447363 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:58.447380 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:58.447426 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:58.450821 (+ 3395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:58.451756 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:58.451764 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:58.451767 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:58.451931 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:58.452459 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:58.452465 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:58.452468 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:58.452970 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:58.453327 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:58.453710 (+ 383us) server_negotiation.cc:299] Negotiation successful
0808 23:33:58.454005 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":324,"threads_started":1}
I20260808 23:33:58.455070 3383 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:58.595160 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 3249
I20260808 23:33:58.625998 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 3394
Aug 08 23:33:58 dist-test-slave-1x4g krb5kdc[2977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.207.195@KRBTEST.COM
I20260808 23:33:58.644155 3682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:33:58.626894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42058 (local address 127.26.207.195:39973)
0808 23:33:58.627445 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0808 23:33:58.627451 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:33:58.627470 (+ 19us) server_negotiation.cc:407] Connection header received
0808 23:33:58.627531 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:33:58.627535 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:33:58.627598 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:33:58.627698 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:33:58.629240 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:58.630076 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:58.632001 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:33:58.632451 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:33:58.632559 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:33:58.637641 (+ 5082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:33:58.637689 (+ 48us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:33:58.637714 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:33:58.637775 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:33:58.641284 (+ 3509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:58.642111 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:58.642120 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:58.642122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:58.642276 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:33:58.642669 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:33:58.642673 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:33:58.642675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:33:58.643082 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:33:58.643343 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0808 23:33:58.643654 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 23:33:58.643851 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":325,"threads_started":1}
I20260808 23:33:58.645017 3533 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:58.747357 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 3394
I20260808 23:33:58.769982 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 2991
I20260808 23:33:58.771272 3067 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:33:58.896045 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 2991
2026-08-08T23:33:58Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6786 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:33:59 dist-test-slave-1x4g krb5kdc[3687](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:33:59 dist-test-slave-1x4g krb5kdc[3687](info): set up 2 sockets
Aug 08 23:33:59 dist-test-slave-1x4g krb5kdc[3687](info): commencing operation
krb5kdc: starting...
W20260808 23:34:00.090466 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:34:00 dist-test-slave-1x4g krb5kdc[3687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:34:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:34:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:34:00.435667 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:42963
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:42933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:42963
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:34:00.836221 3701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:00.836555 3701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:00.836679 3701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:00.845324 3701 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:34:00.845475 3701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:00.845527 3701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:00.845587 3701 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:34:00.845638 3701 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:34:00.858114 3701 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:42933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:42963
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:42963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:00.859670 3701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:00.861235 3701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:00.876044 3707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:00.876139 3706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:00.876288 3710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:00.877259 3701 server_base.cc:1034] running on GCE node
I20260808 23:34:00.878270 3701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:00.880106 3701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:00.881434 3701 hybrid_clock.cc:648] HybridClock initialized: now 1786232040881351 us; error 71 us; skew 500 ppm
I20260808 23:34:00.881887 3701 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T23:34:00Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2064 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:34:01 dist-test-slave-1x4g krb5kdc[3717](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:34:01 dist-test-slave-1x4g krb5kdc[3717](info): set up 2 sockets
Aug 08 23:34:01 dist-test-slave-1x4g krb5kdc[3717](info): commencing operation
krb5kdc: starting...
W20260808 23:34:02.193806 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.000s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:34:02 dist-test-slave-1x4g krb5kdc[3717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:34:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:34:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:34:02.509445 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:36331
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:33215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:36331
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:34:02.897284 3733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:02.897630 3733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:02.897817 3733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:02.905638 3733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:34:02.905781 3733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:02.905871 3733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:02.905968 3733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:34:02.906068 3733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:34:02.917495 3733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:33215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:36331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:36331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:02.919099 3733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:02.920624 3733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:02.934599 3738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:02.934684 3741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:02.934636 3739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:02.935755 3733 server_base.cc:1034] running on GCE node
I20260808 23:34:02.936885 3733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:02.938591 3733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:02.939913 3733 hybrid_clock.cc:648] HybridClock initialized: now 1786232042939839 us; error 56 us; skew 500 ppm
I20260808 23:34:02.940356 3733 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:34:02 dist-test-slave-1x4g krb5kdc[3717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232042, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:34:02.944240 3733 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:34:02.946295 3733 webserver.cc:460] Webserver started at http://127.26.207.254:40783/ using document root <none> and password file <none>
I20260808 23:34:02.947118 3733 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:02.947288 3733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:02.947655 3733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:34:02.951328 3733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "07e2f2d451304973b78e0d8993c03ea7"
format_stamp: "Formatted at 2026-08-08 23:34:02 on dist-test-slave-1x4g"
server_key: "1e851985e6da3aaaf0ac30987948d200"
server_key_iv: "17ab77b4085527a77cb222f973c4cfd3"
server_key_version: "encryptionkey@0"
I20260808 23:34:02.952250 3733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "07e2f2d451304973b78e0d8993c03ea7"
format_stamp: "Formatted at 2026-08-08 23:34:02 on dist-test-slave-1x4g"
server_key: "1e851985e6da3aaaf0ac30987948d200"
server_key_iv: "17ab77b4085527a77cb222f973c4cfd3"
server_key_version: "encryptionkey@0"
I20260808 23:34:02.958508 3733 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 23:34:02.962742 3748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:02.964457 3733 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 23:34:02.964709 3733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "07e2f2d451304973b78e0d8993c03ea7"
format_stamp: "Formatted at 2026-08-08 23:34:02 on dist-test-slave-1x4g"
server_key: "1e851985e6da3aaaf0ac30987948d200"
server_key_iv: "17ab77b4085527a77cb222f973c4cfd3"
server_key_version: "encryptionkey@0"
I20260808 23:34:02.965055 3733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:02.986110 3733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:02.991552 3733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:02.991936 3733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:03.015066 3733 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:36331
I20260808 23:34:03.015090 3801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:36331 every 8 connection(s)
I20260808 23:34:03.016847 3733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:34:03.021190 3802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:34:03.022243 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 3733
I20260808 23:34:03.022493 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:34:03.023406 27455 external_mini_cluster.cc:1428] Setting key 34af33afccf01080da861ab25362f82a
I20260808 23:34:03.038259 3802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7: Bootstrap starting.
Aug 08 23:34:03 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:34:03.042379 3802 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7: Neither blocks nor log segments found. Creating new log.
I20260808 23:34:03.043788 3802 log.cc:824] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7: Log is configured to *not* fsync() on all Append() calls
I20260808 23:34:03.047260 3802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7: No bootstrap required, opened a new log
I20260808 23:34:03.050464 3805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:03.025919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37400 (local address 127.26.207.254:36331)
0808 23:34:03.026846 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:03.026859 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:03.026910 (+ 51us) server_negotiation.cc:407] Connection header received
0808 23:34:03.028706 (+ 1796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:03.028741 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:03.029333 (+ 592us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:03.029736 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:03.031916 (+ 2180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:03.033500 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:03.035501 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:03.036444 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:03.036625 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:03.041812 (+ 5187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:03.041822 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:03.041839 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:03.041885 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:03.045552 (+ 3667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:03.046445 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:03.046452 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:03.046459 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:03.046648 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:03.047133 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:03.047139 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:03.047142 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:03.047802 (+ 660us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:03.048153 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:03.048688 (+ 535us) server_negotiation.cc:299] Negotiation successful
0808 23:34:03.049224 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":674,"thread_start_us":433,"threads_started":1}
I20260808 23:34:03.056588 3802 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e2f2d451304973b78e0d8993c03ea7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36331 } }
I20260808 23:34:03.057176 3802 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:34:03.057291 3802 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07e2f2d451304973b78e0d8993c03ea7, State: Initialized, Role: FOLLOWER
I20260808 23:34:03.057924 3802 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e2f2d451304973b78e0d8993c03ea7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36331 } }
I20260808 23:34:03.058203 3802 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:34:03.058348 3802 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:34:03.058501 3802 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:34:03.061376 3802 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e2f2d451304973b78e0d8993c03ea7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36331 } }
I20260808 23:34:03.061991 3802 leader_election.cc:302] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07e2f2d451304973b78e0d8993c03ea7; no voters:
I20260808 23:34:03.062655 3802 leader_election.cc:288] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:34:03.062829 3807 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:34:03.064096 3807 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 1 LEADER]: Becoming Leader. State: Replica: 07e2f2d451304973b78e0d8993c03ea7, State: Running, Role: LEADER
I20260808 23:34:03.064886 3807 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e2f2d451304973b78e0d8993c03ea7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36331 } }
I20260808 23:34:03.065237 3802 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:34:03.068869 3809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07e2f2d451304973b78e0d8993c03ea7. Latest consensus state: current_term: 1 leader_uuid: "07e2f2d451304973b78e0d8993c03ea7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e2f2d451304973b78e0d8993c03ea7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36331 } } }
I20260808 23:34:03.069536 3809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [sys.catalog]: This master's current role is: LEADER
I20260808 23:34:03.068974 3808 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07e2f2d451304973b78e0d8993c03ea7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e2f2d451304973b78e0d8993c03ea7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36331 } } }
I20260808 23:34:03.069792 3808 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [sys.catalog]: This master's current role is: LEADER
I20260808 23:34:03.070833 3816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:34:03.082104 3816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:34:03.093451 3816 catalog_manager.cc:1347] Generated new cluster ID: 00c7b8559bbb4294a90e3b4d00eab57e
I20260808 23:34:03.093601 3816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:34:03.107903 3816 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:34:03.109701 3816 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:34:03.123119 3816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7: Generated new TSK 0
I20260808 23:34:03.124481 3816 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:34:03.202469 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36331
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:33215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:34:03.591483 3828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:03.591797 3828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:03.591990 3828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:03.599660 3828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:03.599793 3828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:03.600000 3828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:34:03.610417 3828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:33215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36331
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:03.611963 3828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:03.613601 3828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:03.628747 3836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:03.628728 3834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:03.628729 3833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:03.629727 3828 server_base.cc:1034] running on GCE node
I20260808 23:34:03.630481 3828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:03.631614 3828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:03.632930 3828 hybrid_clock.cc:648] HybridClock initialized: now 1786232043632847 us; error 70 us; skew 500 ppm
I20260808 23:34:03.633314 3828 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:34:03 dist-test-slave-1x4g krb5kdc[3717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232043, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:34:03.637200 3828 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:34:03.639019 3828 webserver.cc:460] Webserver started at http://127.26.207.193:45257/ using document root <none> and password file <none>
I20260808 23:34:03.639848 3828 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:03.640019 3828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:03.640377 3828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:34:03.643802 3828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "1d765d0d99b44a35a06b1c365733062d"
format_stamp: "Formatted at 2026-08-08 23:34:03 on dist-test-slave-1x4g"
server_key: "831f4fa4039d0140f76cd432836ef062"
server_key_iv: "f6d061850fa35b4aebffe3f9b0dc390b"
server_key_version: "encryptionkey@0"
I20260808 23:34:03.644750 3828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "1d765d0d99b44a35a06b1c365733062d"
format_stamp: "Formatted at 2026-08-08 23:34:03 on dist-test-slave-1x4g"
server_key: "831f4fa4039d0140f76cd432836ef062"
server_key_iv: "f6d061850fa35b4aebffe3f9b0dc390b"
server_key_version: "encryptionkey@0"
I20260808 23:34:03.650776 3828 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 23:34:03.655071 3843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:03.656740 3828 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 23:34:03.657042 3828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "1d765d0d99b44a35a06b1c365733062d"
format_stamp: "Formatted at 2026-08-08 23:34:03 on dist-test-slave-1x4g"
server_key: "831f4fa4039d0140f76cd432836ef062"
server_key_iv: "f6d061850fa35b4aebffe3f9b0dc390b"
server_key_version: "encryptionkey@0"
I20260808 23:34:03.657306 3828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:03.684669 3828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:03.690109 3828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:03.690490 3828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:03.691625 3828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:34:03.693269 3828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:34:03.693430 3828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:03.693598 3828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:34:03.693681 3828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:03.732120 3828 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:41503
I20260808 23:34:03.732177 3961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:41503 every 8 connection(s)
I20260808 23:34:03.733690 3828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:34:03.735924 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 3828
I20260808 23:34:03.736152 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:34:03.737049 27455 external_mini_cluster.cc:1428] Setting key a935658e29b72b6add46fe18a944da48
Aug 08 23:34:03 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232043, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:34:03.763134 3964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:03.737057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:57443 (local address 127.26.207.254:36331)
0808 23:34:03.737621 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:03.737628 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:03.739006 (+ 1378us) server_negotiation.cc:407] Connection header received
0808 23:34:03.742134 (+ 3128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:03.742139 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:03.742219 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:03.742322 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:03.744908 (+ 2586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:03.745698 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:03.748430 (+ 2732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:03.748939 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:03.749062 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:03.754609 (+ 5547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:03.754620 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:03.754629 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:03.754687 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:03.758741 (+ 4054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:03.759803 (+ 1062us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:03.759812 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:03.759819 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:03.760016 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:03.760638 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:03.760646 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:03.760652 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:03.761166 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:03.761430 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:03.762264 (+ 834us) server_negotiation.cc:299] Negotiation successful
0808 23:34:03.762611 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":281,"threads_started":1}
I20260808 23:34:03.763934 3965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:03.737773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:57443)
0808 23:34:03.738802 (+ 1029us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:03.738869 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:03.741691 (+ 2822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:03.742684 (+ 993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:03.742700 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:03.743627 (+ 927us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:03.744584 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:03.744617 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:03.745906 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:03.745914 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:03.748231 (+ 2317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:03.748261 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:03.749212 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:03.749222 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:03.749896 (+ 674us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:03.751057 (+ 1161us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:03.751096 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:03.754250 (+ 3154us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:34:03.758998 (+ 4748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:34:03.759008 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:34:03.759027 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:34:03.759622 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:34:03.760161 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:34:03.760164 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:34:03.760166 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:34:03.760467 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:34:03.761357 (+ 890us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:34:03.761368 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:34:03.761817 (+ 449us) client_negotiation.cc:769] Sending connection context
0808 23:34:03.762086 (+ 269us) client_negotiation.cc:240] Negotiation successful
0808 23:34:03.762656 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"thread_start_us":419,"threads_started":1}
I20260808 23:34:03.766047 3962 heartbeater.cc:347] Connected to a master server at 127.26.207.254:36331
I20260808 23:34:03.766429 3962 heartbeater.cc:464] Registering TS with master...
I20260808 23:34:03.767405 3962 heartbeater.cc:511] Master 127.26.207.254:36331 requested a full tablet report, sending...
I20260808 23:34:03.769951 3765 ts_manager.cc:194] Registered new tserver with Master: 1d765d0d99b44a35a06b1c365733062d (127.26.207.193:41503)
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
I20260808 23:34:03.771679 3765 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:57443
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:34:03.813715 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36331
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:33215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:34:04.193655 3968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:04.194029 3968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:04.194238 3968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:04.202903 3968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:04.203210 3968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:04.203424 3968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:34:04.214654 3968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:33215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36331
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:04.216202 3968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:04.217836 3968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:04.233691 3973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:04.233623 3974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:04.233670 3977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:04.234777 3968 server_base.cc:1034] running on GCE node
I20260808 23:34:04.235551 3968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:04.236735 3968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:04.238138 3968 hybrid_clock.cc:648] HybridClock initialized: now 1786232044238091 us; error 47 us; skew 500 ppm
I20260808 23:34:04.238543 3968 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:34:04 dist-test-slave-1x4g krb5kdc[3717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232044, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:34:04.242705 3968 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:34:04.244729 3968 webserver.cc:460] Webserver started at http://127.26.207.194:35029/ using document root <none> and password file <none>
I20260808 23:34:04.245743 3968 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:04.245939 3968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:04.246335 3968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:34:04.250120 3968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "6f7fc3aa591641cca8cbbadcf672d64e"
format_stamp: "Formatted at 2026-08-08 23:34:04 on dist-test-slave-1x4g"
server_key: "b50744d8bf7473658db50aad6be09378"
server_key_iv: "2a5202f0e9676f5eb5bade00c83eae96"
server_key_version: "encryptionkey@0"
I20260808 23:34:04.251148 3968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "6f7fc3aa591641cca8cbbadcf672d64e"
format_stamp: "Formatted at 2026-08-08 23:34:04 on dist-test-slave-1x4g"
server_key: "b50744d8bf7473658db50aad6be09378"
server_key_iv: "2a5202f0e9676f5eb5bade00c83eae96"
server_key_version: "encryptionkey@0"
I20260808 23:34:04.257771 3968 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.003s
I20260808 23:34:04.262483 3984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:04.264287 3968 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260808 23:34:04.264571 3968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "6f7fc3aa591641cca8cbbadcf672d64e"
format_stamp: "Formatted at 2026-08-08 23:34:04 on dist-test-slave-1x4g"
server_key: "b50744d8bf7473658db50aad6be09378"
server_key_iv: "2a5202f0e9676f5eb5bade00c83eae96"
server_key_version: "encryptionkey@0"
I20260808 23:34:04.264878 3968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:04.285199 3968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:04.290313 3968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:04.290688 3968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:04.291815 3968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:34:04.293506 3968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:34:04.293629 3968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:04.293799 3968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:34:04.293877 3968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:04.335959 3968 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:46599
I20260808 23:34:04.336064 4101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:46599 every 8 connection(s)
I20260808 23:34:04.337657 3968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:34:04.347173 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 3968
I20260808 23:34:04.347416 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:34:04.348031 27455 external_mini_cluster.cc:1428] Setting key 9f2d6ef2955e594fa79f208741cab952
Aug 08 23:34:04 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232044, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:34:04.363298 4104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:04.340749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:45215 (local address 127.26.207.254:36331)
0808 23:34:04.341317 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:04.341322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:04.342378 (+ 1056us) server_negotiation.cc:407] Connection header received
0808 23:34:04.344431 (+ 2053us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:04.344438 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:04.344547 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:04.344693 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:04.346510 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:04.347314 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:04.349975 (+ 2661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:04.350715 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:04.350834 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:04.356056 (+ 5222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:04.356063 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:04.356066 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:04.356110 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:04.359144 (+ 3034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:04.360133 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:04.360139 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:04.360141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:04.360304 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:04.360926 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:04.360931 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:04.360934 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:04.361256 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:04.361443 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:04.362571 (+ 1128us) server_negotiation.cc:299] Negotiation successful
0808 23:34:04.362877 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":290,"threads_started":1}
I20260808 23:34:04.364477 4105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:04.341347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:45215)
0808 23:34:04.342193 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:04.342237 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:04.344093 (+ 1856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:04.345011 (+ 918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:04.345021 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:04.345636 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:04.346283 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:04.346305 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:04.347656 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:04.347664 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:04.349770 (+ 2106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:04.349788 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:04.351019 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:04.351030 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:04.351421 (+ 391us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:04.352284 (+ 863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:04.352332 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:04.355695 (+ 3363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:34:04.359369 (+ 3674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:34:04.359381 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:34:04.359409 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:34:04.359953 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:34:04.360442 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:34:04.360447 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:34:04.360451 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:34:04.360750 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:34:04.361414 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:34:04.361423 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:34:04.362083 (+ 660us) client_negotiation.cc:769] Sending connection context
0808 23:34:04.362436 (+ 353us) client_negotiation.cc:240] Negotiation successful
0808 23:34:04.363103 (+ 667us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":339,"threads_started":1}
I20260808 23:34:04.366158 4102 heartbeater.cc:347] Connected to a master server at 127.26.207.254:36331
I20260808 23:34:04.366567 4102 heartbeater.cc:464] Registering TS with master...
I20260808 23:34:04.367444 4102 heartbeater.cc:511] Master 127.26.207.254:36331 requested a full tablet report, sending...
I20260808 23:34:04.369354 3765 ts_manager.cc:194] Registered new tserver with Master: 6f7fc3aa591641cca8cbbadcf672d64e (127.26.207.194:46599)
I20260808 23:34:04.370832 3765 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:45215
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:34:04.422102 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36331
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:33215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:34:04.775068 3962 heartbeater.cc:503] Master 127.26.207.254:36331 was elected leader, sending a full tablet report...
W20260808 23:34:04.799710 4108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:04.800055 4108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:04.800213 4108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:04.808195 4108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:04.808338 4108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:04.808542 4108 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:34:04.819236 4108 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:33215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36331
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:04.820701 4108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:04.822196 4108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:04.839416 4116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:04.839408 4114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:04.840044 4113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:04.840552 4108 server_base.cc:1034] running on GCE node
I20260808 23:34:04.841305 4108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:04.842403 4108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:04.843660 4108 hybrid_clock.cc:648] HybridClock initialized: now 1786232044843610 us; error 55 us; skew 500 ppm
I20260808 23:34:04.844060 4108 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:34:04 dist-test-slave-1x4g krb5kdc[3717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232044, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:34:04.847728 4108 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:34:04.849486 4108 webserver.cc:460] Webserver started at http://127.26.207.195:37403/ using document root <none> and password file <none>
I20260808 23:34:04.850253 4108 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:04.850368 4108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:04.850672 4108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:34:04.854144 4108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "c3487998dc0947b796d3db179c192868"
format_stamp: "Formatted at 2026-08-08 23:34:04 on dist-test-slave-1x4g"
server_key: "1e88e704438cc57d1f92a004f66a215e"
server_key_iv: "314fca564caa39f7c489bfcfab67eea9"
server_key_version: "encryptionkey@0"
I20260808 23:34:04.855041 4108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "c3487998dc0947b796d3db179c192868"
format_stamp: "Formatted at 2026-08-08 23:34:04 on dist-test-slave-1x4g"
server_key: "1e88e704438cc57d1f92a004f66a215e"
server_key_iv: "314fca564caa39f7c489bfcfab67eea9"
server_key_version: "encryptionkey@0"
I20260808 23:34:04.861423 4108 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 23:34:04.866099 4124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:04.868141 4108 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 23:34:04.868377 4108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "c3487998dc0947b796d3db179c192868"
format_stamp: "Formatted at 2026-08-08 23:34:04 on dist-test-slave-1x4g"
server_key: "1e88e704438cc57d1f92a004f66a215e"
server_key_iv: "314fca564caa39f7c489bfcfab67eea9"
server_key_version: "encryptionkey@0"
I20260808 23:34:04.868655 4108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:04.896065 4108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:04.900830 4108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:04.901185 4108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:04.902328 4108 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:34:04.904021 4108 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:34:04.904110 4108 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:04.904289 4108 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:34:04.904366 4108 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:04.941461 4108 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:42251
I20260808 23:34:04.941525 4244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:42251 every 8 connection(s)
I20260808 23:34:04.942941 4108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:34:04.945766 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 4108
I20260808 23:34:04.945996 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:34:04.946627 27455 external_mini_cluster.cc:1428] Setting key 34a2cd2e69a6ef5735b88a2edc400b74
Aug 08 23:34:04 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232044, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:34:04.967156 4247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:04.945954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:60061 (local address 127.26.207.254:36331)
0808 23:34:04.946459 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:04.946477 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:04.947622 (+ 1145us) server_negotiation.cc:407] Connection header received
0808 23:34:04.950345 (+ 2723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:04.950350 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:04.950445 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:04.950595 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:04.952282 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:04.953208 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:04.954896 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:04.955336 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:04.955493 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:04.959626 (+ 4133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:04.959633 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:04.959636 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:04.959676 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:04.963528 (+ 3852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:04.964479 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:04.964484 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:04.964487 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:04.964634 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:04.965339 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:04.965343 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:04.965345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:04.965649 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:04.965782 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:04.966650 (+ 868us) server_negotiation.cc:299] Negotiation successful
0808 23:34:04.966852 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":235,"threads_started":1}
I20260808 23:34:04.968228 4248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:04.946501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:60061)
0808 23:34:04.947421 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:04.947488 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:04.950017 (+ 2529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:04.950872 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:04.950882 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:04.951448 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:04.952086 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:04.952104 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:04.953378 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:04.953386 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:04.954715 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:04.954730 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:04.955609 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:04.955616 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:04.956002 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:04.956745 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:04.956770 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:04.959320 (+ 2550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:34:04.963715 (+ 4395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:34:04.963724 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:34:04.963742 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:34:04.964321 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:34:04.964859 (+ 538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:34:04.964868 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:34:04.964871 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:34:04.965216 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:34:04.965786 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:34:04.965793 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:34:04.966255 (+ 462us) client_negotiation.cc:769] Sending connection context
0808 23:34:04.966527 (+ 272us) client_negotiation.cc:240] Negotiation successful
0808 23:34:04.966982 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":338,"threads_started":1}
I20260808 23:34:04.970196 4245 heartbeater.cc:347] Connected to a master server at 127.26.207.254:36331
I20260808 23:34:04.970582 4245 heartbeater.cc:464] Registering TS with master...
I20260808 23:34:04.971572 4245 heartbeater.cc:511] Master 127.26.207.254:36331 requested a full tablet report, sending...
I20260808 23:34:04.973379 3765 ts_manager.cc:194] Registered new tserver with Master: c3487998dc0947b796d3db179c192868 (127.26.207.195:42251)
I20260808 23:34:04.974578 3765 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:60061
I20260808 23:34:04.976493 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.193.keytab.
Entry for principal oryx/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.193.keytab.
WARNING: no policy specified for oryx/127.26.207.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.207.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.194.keytab.
Entry for principal oryx/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.194.keytab.
WARNING: no policy specified for oryx/127.26.207.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.195.keytab.
Entry for principal oryx/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.195.keytab.
I20260808 23:34:05.177685 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 3828
Aug 08 23:34:05 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:34:05.201434 4257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:05.179283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33366 (local address 127.26.207.193:41503)
0808 23:34:05.180034 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:05.180041 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:05.180075 (+ 34us) server_negotiation.cc:407] Connection header received
0808 23:34:05.180161 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:05.180168 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:05.180436 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:05.180592 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:05.183166 (+ 2574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:05.184355 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:05.186119 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:05.187087 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:05.187391 (+ 304us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:05.193109 (+ 5718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:05.193137 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:05.193159 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:05.193217 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:05.196722 (+ 3505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:05.197974 (+ 1252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:05.197988 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:05.197990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:05.198318 (+ 328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:05.199169 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:05.199176 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:05.199179 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:05.199765 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:05.200102 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:05.200593 (+ 491us) server_negotiation.cc:299] Negotiation successful
0808 23:34:05.200973 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":401,"threads_started":1}
I20260808 23:34:05.203367 3957 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:05.295125 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 3828
I20260808 23:34:05.318087 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 3968
Aug 08 23:34:05 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:34:05.339783 4259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:05.319295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60442 (local address 127.26.207.194:46599)
0808 23:34:05.320021 (+ 726us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:05.320031 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:05.320094 (+ 63us) server_negotiation.cc:407] Connection header received
0808 23:34:05.320212 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:05.320223 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:05.320524 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:05.320720 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:05.322523 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:05.323641 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:05.325226 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:05.325859 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:05.325989 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:05.331150 (+ 5161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:05.331178 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:05.331203 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:05.331268 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:05.335779 (+ 4511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:05.337032 (+ 1253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:05.337041 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:05.337044 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:05.337250 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:05.337747 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:05.337751 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:05.337753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:05.338180 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:05.338479 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:05.338943 (+ 464us) server_negotiation.cc:299] Negotiation successful
0808 23:34:05.339198 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":413,"threads_started":1}
I20260808 23:34:05.341646 4097 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:05.435112 4102 heartbeater.cc:503] Master 127.26.207.254:36331 was elected leader, sending a full tablet report...
I20260808 23:34:05.436357 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 3968
W20260808 23:34:05.459730 3751 connection.cc:535] server connection from 127.26.207.194:45215 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 23:34:05.460301 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 4108
Aug 08 23:34:05 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:34:05.486223 4261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:05.462616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49506 (local address 127.26.207.195:42251)
0808 23:34:05.463599 (+ 983us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:05.463608 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:05.463651 (+ 43us) server_negotiation.cc:407] Connection header received
0808 23:34:05.463723 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:05.463731 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:05.463995 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:05.464244 (+ 249us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:05.466279 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:05.467503 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:05.469821 (+ 2318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:05.471265 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:05.471578 (+ 313us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:05.478027 (+ 6449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:05.478049 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:05.478069 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:05.478251 (+ 182us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:05.482395 (+ 4144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:05.483630 (+ 1235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:05.483639 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:05.483641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:05.483821 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:05.484363 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:05.484368 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:05.484370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:05.484910 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:05.485227 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:05.485587 (+ 360us) server_negotiation.cc:299] Negotiation successful
0808 23:34:05.485834 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":365,"threads_started":1}
I20260808 23:34:05.488114 4240 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:05.583065 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 4108
I20260808 23:34:05.606796 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 3733
I20260808 23:34:05.608150 3797 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:05.725606 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 3733
I20260808 23:34:05.754051 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:36331
--webserver_interface=127.26.207.254
--webserver_port=40783
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:33215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:36331
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:34:06.125186 4264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:06.125526 4264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:06.125710 4264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:06.133473 4264 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:34:06.133610 4264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:06.133731 4264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:06.133824 4264 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:34:06.133867 4264 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:34:06.144445 4264 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:33215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:36331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:36331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=40783
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:06.146024 4264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:06.147519 4264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:06.161135 4269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:06.161212 4270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:06.161509 4272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:06.162384 4264 server_base.cc:1034] running on GCE node
I20260808 23:34:06.163707 4264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:06.166405 4264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:06.167694 4264 hybrid_clock.cc:648] HybridClock initialized: now 1786232046167639 us; error 52 us; skew 500 ppm
I20260808 23:34:06.168206 4264 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:34:06 dist-test-slave-1x4g krb5kdc[3717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232046, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:34:06.178472 4264 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:34:06.180876 4264 webserver.cc:460] Webserver started at http://127.26.207.254:40783/ using document root <none> and password file <none>
I20260808 23:34:06.181779 4264 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:06.181993 4264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:06.188668 4264 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 23:34:06.192003 4279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:06.193744 4264 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 23:34:06.194031 4264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "07e2f2d451304973b78e0d8993c03ea7"
format_stamp: "Formatted at 2026-08-08 23:34:02 on dist-test-slave-1x4g"
server_key: "1e851985e6da3aaaf0ac30987948d200"
server_key_iv: "17ab77b4085527a77cb222f973c4cfd3"
server_key_version: "encryptionkey@0"
I20260808 23:34:06.195232 4264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:06.222716 4264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:06.227764 4264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:06.228123 4264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:06.249390 4264 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:36331
I20260808 23:34:06.249418 4334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:36331 every 8 connection(s)
I20260808 23:34:06.251116 4264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:34:06.257431 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 4264
I20260808 23:34:06.258302 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:41503
--local_ip_for_outbound_sockets=127.26.207.193
--tserver_master_addrs=127.26.207.254:36331
--webserver_port=45257
--webserver_interface=127.26.207.193
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:33215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.207.193
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:34:06.259083 4335 sys_catalog.cc:263] Verifying existing consensus state
I20260808 23:34:06.263031 4335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7: Bootstrap starting.
I20260808 23:34:06.285048 4335 log.cc:824] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7: Log is configured to *not* fsync() on all Append() calls
I20260808 23:34:06.295490 4335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 23:34:06.296150 4335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7: Bootstrap complete.
I20260808 23:34:06.307159 4335 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e2f2d451304973b78e0d8993c03ea7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36331 } }
I20260808 23:34:06.308209 4335 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07e2f2d451304973b78e0d8993c03ea7, State: Initialized, Role: FOLLOWER
I20260808 23:34:06.309007 4335 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e2f2d451304973b78e0d8993c03ea7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36331 } }
I20260808 23:34:06.309300 4335 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:34:06.309448 4335 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:34:06.309648 4335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 1 FOLLOWER]: Advancing to term 2
I20260808 23:34:06.314128 4335 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e2f2d451304973b78e0d8993c03ea7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36331 } }
I20260808 23:34:06.314725 4335 leader_election.cc:302] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07e2f2d451304973b78e0d8993c03ea7; no voters:
I20260808 23:34:06.315420 4335 leader_election.cc:288] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 23:34:06.315583 4340 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 23:34:06.316866 4340 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [term 2 LEADER]: Becoming Leader. State: Replica: 07e2f2d451304973b78e0d8993c03ea7, State: Running, Role: LEADER
I20260808 23:34:06.317570 4340 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e2f2d451304973b78e0d8993c03ea7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36331 } }
I20260808 23:34:06.317945 4335 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:34:06.320284 4342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07e2f2d451304973b78e0d8993c03ea7. Latest consensus state: current_term: 2 leader_uuid: "07e2f2d451304973b78e0d8993c03ea7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e2f2d451304973b78e0d8993c03ea7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36331 } } }
I20260808 23:34:06.320701 4342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [sys.catalog]: This master's current role is: LEADER
I20260808 23:34:06.321352 4341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "07e2f2d451304973b78e0d8993c03ea7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e2f2d451304973b78e0d8993c03ea7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36331 } } }
I20260808 23:34:06.321709 4341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7 [sys.catalog]: This master's current role is: LEADER
I20260808 23:34:06.332149 4347 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:34:06.339994 4347 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:34:06.341673 4347 catalog_manager.cc:1259] Loaded cluster ID: 00c7b8559bbb4294a90e3b4d00eab57e
I20260808 23:34:06.341895 4347 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:34:06.346386 4347 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:34:06.348188 4347 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 07e2f2d451304973b78e0d8993c03ea7: Loaded TSK: 0
I20260808 23:34:06.349918 4347 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 23:34:06.659624 4337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:06.660032 4337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:06.660211 4337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:06.668119 4337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:06.668323 4337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:06.668516 4337 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:34:06.679064 4337 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:33215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.193.keytab
--principal=oryx/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:41503
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=45257
--tserver_master_addrs=127.26.207.254:36331
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:06.680626 4337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:06.682291 4337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:06.699131 4363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:06.699218 4365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:06.700071 4362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:06.701923 4337 server_base.cc:1034] running on GCE node
I20260808 23:34:06.702780 4337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:06.704097 4337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:06.705374 4337 hybrid_clock.cc:648] HybridClock initialized: now 1786232046705323 us; error 45 us; skew 500 ppm
I20260808 23:34:06.705825 4337 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:34:06 dist-test-slave-1x4g krb5kdc[3717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232046, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:34:06.710433 4337 init.cc:377] Logged in from keytab as oryx/127.26.207.193@KRBTEST.COM (short username oryx)
I20260808 23:34:06.712560 4337 webserver.cc:460] Webserver started at http://127.26.207.193:45257/ using document root <none> and password file <none>
I20260808 23:34:06.713574 4337 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:06.713753 4337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:06.721920 4337 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 23:34:06.725355 4373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:06.727054 4337 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 23:34:06.727305 4337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "1d765d0d99b44a35a06b1c365733062d"
format_stamp: "Formatted at 2026-08-08 23:34:03 on dist-test-slave-1x4g"
server_key: "831f4fa4039d0140f76cd432836ef062"
server_key_iv: "f6d061850fa35b4aebffe3f9b0dc390b"
server_key_version: "encryptionkey@0"
I20260808 23:34:06.728497 4337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:06.749650 4337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:06.754912 4337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:06.755312 4337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:06.756515 4337 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:34:06.758265 4337 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:34:06.758371 4337 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:06.758561 4337 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:34:06.758671 4337 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:06.797854 4337 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:41503
I20260808 23:34:06.797961 4493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:41503 every 8 connection(s)
I20260808 23:34:06.799600 4337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:34:06.804756 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 4337
I20260808 23:34:06.805666 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:46599
--local_ip_for_outbound_sockets=127.26.207.194
--tserver_master_addrs=127.26.207.254:36331
--webserver_port=35029
--webserver_interface=127.26.207.194
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:33215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.207.194
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 23:34:06 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:06 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:06.824323 4497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:06.803162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:38853)
0808 23:34:06.804243 (+ 1081us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:06.804313 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:06.807336 (+ 3023us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:06.809117 (+ 1781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:06.809131 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:06.809981 (+ 850us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:06.810825 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:06.810855 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:06.812799 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:06.812809 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:06.815165 (+ 2356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:06.815189 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:06.816981 (+ 1792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:06.816992 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:06.817360 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:06.818409 (+ 1049us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:06.818450 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:06.823205 (+ 4755us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":750,"thread_start_us":533,"threads_started":1}
W20260808 23:34:06.825017 4496 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:06.803173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:38853 (local address 127.26.207.254:36331)
0808 23:34:06.804058 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:06.804075 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:06.804487 (+ 412us) server_negotiation.cc:407] Connection header received
0808 23:34:06.808067 (+ 3580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:06.808081 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:06.808478 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:06.808897 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:06.811111 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:06.812534 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:06.815427 (+ 2893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:06.816536 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:06.816828 (+ 292us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:06.823659 (+ 6831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:38853: BlockingRecv error: recv got EOF from 127.26.207.193:38853 (error 108)
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":333,"threads_started":1}
W20260808 23:34:06.825270 4494 heartbeater.cc:644] Failed to heartbeat to 127.26.207.254:36331 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.207.254:36331: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Aug 08 23:34:06 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:06 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:06.840224 4497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:06.826004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:47433)
0808 23:34:06.826225 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:06.826249 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:06.826374 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:06.826840 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:06.826846 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:06.827411 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:06.827657 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:06.827674 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:06.829391 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:06.829428 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:06.831998 (+ 2570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:06.832061 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:06.833978 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:06.833988 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:06.834250 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:06.835105 (+ 855us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:06.835136 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:06.839822 (+ 4686us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":72}
W20260808 23:34:06.840276 4496 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:06.826198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:47433 (local address 127.26.207.254:36331)
0808 23:34:06.826440 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:06.826449 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:06.826477 (+ 28us) server_negotiation.cc:407] Connection header received
0808 23:34:06.826558 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:06.826566 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:06.826656 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:06.826770 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:06.827870 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:06.829142 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:06.832442 (+ 3300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:06.833622 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:06.833811 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:06.840072 (+ 6261us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:47433: BlockingRecv error: recv got EOF from 127.26.207.193:47433 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 08 23:34:06 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:06 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:06.850953 4497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:06.841424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:37979)
0808 23:34:06.841647 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:06.841670 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:06.841794 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:06.842180 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:06.842185 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:06.842582 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:06.842761 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:06.842772 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:06.843911 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:06.843918 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:06.844974 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:06.844990 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:06.845915 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:06.845925 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:06.846215 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:06.846893 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:06.846919 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:06.850623 (+ 3704us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 23:34:06.851464 4494 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 23:34:06.851524 4496 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:06.841547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:37979 (local address 127.26.207.254:36331)
0808 23:34:06.841747 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:06.841753 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:06.841774 (+ 21us) server_negotiation.cc:407] Connection header received
0808 23:34:06.841915 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:06.841920 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:06.842025 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:06.842141 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:06.842939 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:06.843729 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:06.845146 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:06.845697 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:06.845861 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:06.851012 (+ 5151us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:37979: BlockingRecv error: recv got EOF from 127.26.207.193:37979 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260808 23:34:07.177567 4498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:07.177966 4498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:07.178139 4498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:07.185844 4498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:07.186051 4498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:07.186244 4498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:34:07.196851 4498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:33215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.194.keytab
--principal=oryx/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:46599
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=35029
--tserver_master_addrs=127.26.207.254:36331
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:07.198421 4498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:07.199973 4498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:07.215091 4506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:07.215052 4504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:07.215052 4503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:07.216869 4498 server_base.cc:1034] running on GCE node
I20260808 23:34:07.217640 4498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:07.218914 4498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:07.220170 4498 hybrid_clock.cc:648] HybridClock initialized: now 1786232047220110 us; error 84 us; skew 500 ppm
I20260808 23:34:07.220556 4498 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:34:07 dist-test-slave-1x4g krb5kdc[3717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232047, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:34:07.224161 4498 init.cc:377] Logged in from keytab as oryx/127.26.207.194@KRBTEST.COM (short username oryx)
I20260808 23:34:07.226075 4498 webserver.cc:460] Webserver started at http://127.26.207.194:35029/ using document root <none> and password file <none>
I20260808 23:34:07.226904 4498 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:07.227095 4498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:07.234146 4498 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 23:34:07.237505 4513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:07.239185 4498 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:34:07.239434 4498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "6f7fc3aa591641cca8cbbadcf672d64e"
format_stamp: "Formatted at 2026-08-08 23:34:04 on dist-test-slave-1x4g"
server_key: "b50744d8bf7473658db50aad6be09378"
server_key_iv: "2a5202f0e9676f5eb5bade00c83eae96"
server_key_version: "encryptionkey@0"
I20260808 23:34:07.240536 4498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:07.273785 4498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:07.278640 4498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:07.278983 4498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:07.280123 4498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:34:07.281805 4498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:34:07.281949 4498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:07.282107 4498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:34:07.282214 4498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:07.320612 4498 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:46599
I20260808 23:34:07.320677 4636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:46599 every 8 connection(s)
I20260808 23:34:07.322444 4498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:34:07.331841 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 4498
I20260808 23:34:07.332612 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:42251
--local_ip_for_outbound_sockets=127.26.207.195
--tserver_master_addrs=127.26.207.254:36331
--webserver_port=37403
--webserver_interface=127.26.207.195
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:33215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.207.195
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 23:34:07 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:07 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 23:34:07.344506 4496 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:07.325917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:43271 (local address 127.26.207.254:36331)
0808 23:34:07.326184 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:07.326192 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:07.328146 (+ 1954us) server_negotiation.cc:407] Connection header received
0808 23:34:07.330927 (+ 2781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:07.330934 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:07.331060 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:07.331196 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:07.333561 (+ 2365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.334497 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.336469 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.337090 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.337262 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:07.344187 (+ 6925us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:43271: BlockingRecv error: recv got EOF from 127.26.207.194:43271 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 23:34:07.345525 4639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:07.326475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:43271)
0808 23:34:07.327881 (+ 1406us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:07.327982 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:07.330552 (+ 2570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:07.331553 (+ 1001us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:07.331563 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:07.332337 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:07.333279 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:07.333306 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.334768 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.334773 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:07.336260 (+ 1487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:07.336276 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.337398 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.337406 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:07.337710 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:07.338578 (+ 868us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:07.338607 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:07.343754 (+ 5147us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":965,"thread_start_us":658,"threads_started":1}
W20260808 23:34:07.346472 4637 heartbeater.cc:644] Failed to heartbeat to 127.26.207.254:36331 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.207.254:36331: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Aug 08 23:34:07 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:07 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:07.357723 4639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:07.347299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:51285)
0808 23:34:07.347822 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:07.347845 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:07.348033 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:07.348452 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:07.348458 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:07.349006 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:07.349180 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:07.349191 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.350398 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.350405 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:07.351633 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:07.351649 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.352533 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.352541 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:07.352748 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:07.353562 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:07.353583 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:07.357351 (+ 3768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":379}
W20260808 23:34:07.357945 4496 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:07.347553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:51285 (local address 127.26.207.254:36331)
0808 23:34:07.347784 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:07.347793 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:07.347952 (+ 159us) server_negotiation.cc:407] Connection header received
0808 23:34:07.348205 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:07.348211 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:07.348283 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:07.348411 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:07.349365 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.350209 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.351809 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.352320 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.352493 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:07.357640 (+ 5147us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:51285: BlockingRecv error: recv got EOF from 127.26.207.194:51285 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 08 23:34:07 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:07 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:07.370569 4639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:07.358819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:54921)
0808 23:34:07.359088 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:07.359115 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:07.359260 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:07.359669 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:07.359677 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:07.360204 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:07.360484 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:07.360501 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.362079 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.362088 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:07.364041 (+ 1953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:07.364068 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.365140 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.365151 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:07.365438 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:07.366152 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:07.366178 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:07.370225 (+ 4047us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99}
W20260808 23:34:07.370952 4637 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 23:34:07.371023 4496 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:07.359005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:54921 (local address 127.26.207.254:36331)
0808 23:34:07.359187 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:07.359191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:07.359211 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:34:07.359404 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:07.359407 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:07.359497 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:07.359589 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:07.360667 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.361837 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.364305 (+ 2468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.364922 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.365070 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:07.370533 (+ 5463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:54921: BlockingRecv error: recv got EOF from 127.26.207.194:54921 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260808 23:34:07.709314 4640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:07.709656 4640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:07.709829 4640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:07.717784 4640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:07.717926 4640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:07.718151 4640 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:34:07.728869 4640 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:33215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/krb5kdc/oryx_127.26.207.195.keytab
--principal=oryx/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:42251
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=37403
--tserver_master_addrs=127.26.207.254:36331
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:07.730428 4640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:07.731894 4640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:07.747593 4645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:07.747570 4646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:07.747474 4648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:07.748490 4640 server_base.cc:1034] running on GCE node
I20260808 23:34:07.749300 4640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:07.750465 4640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:07.751703 4640 hybrid_clock.cc:648] HybridClock initialized: now 1786232047751624 us; error 67 us; skew 500 ppm
I20260808 23:34:07.752107 4640 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:34:07 dist-test-slave-1x4g krb5kdc[3717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232047, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:34:07.755836 4640 init.cc:377] Logged in from keytab as oryx/127.26.207.195@KRBTEST.COM (short username oryx)
I20260808 23:34:07.757603 4640 webserver.cc:460] Webserver started at http://127.26.207.195:37403/ using document root <none> and password file <none>
I20260808 23:34:07.758394 4640 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:07.758565 4640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:07.764541 4640 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 23:34:07.767765 4657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:07.769380 4640 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:34:07.769603 4640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "c3487998dc0947b796d3db179c192868"
format_stamp: "Formatted at 2026-08-08 23:34:04 on dist-test-slave-1x4g"
server_key: "1e88e704438cc57d1f92a004f66a215e"
server_key_iv: "314fca564caa39f7c489bfcfab67eea9"
server_key_version: "encryptionkey@0"
I20260808 23:34:07.770737 4640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:07.788122 4640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:07.793196 4640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:07.793517 4640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:07.794641 4640 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:34:07.796214 4640 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:34:07.796351 4640 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:07.796516 4640 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:34:07.796643 4640 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:07.834594 4640 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:42251
I20260808 23:34:07.834648 4778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:42251 every 8 connection(s)
I20260808 23:34:07.836277 4640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:34:07.837560 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 4640
Aug 08 23:34:07 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:07 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 23:34:07.858369 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:07.839524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:51823 (local address 127.26.207.254:36331)
0808 23:34:07.843495 (+ 3971us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:07.843503 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:07.843527 (+ 24us) server_negotiation.cc:407] Connection header received
0808 23:34:07.844434 (+ 907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:07.844439 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:07.844523 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:07.844669 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:07.846617 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.847474 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.849730 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.850205 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.850370 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:07.858007 (+ 7637us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:51823: BlockingRecv error: recv got EOF from 127.26.207.195:51823 (error 108)
Metrics: {"server-negotiator.queue_time_us":3797,"thread_start_us":3576,"threads_started":1}
I20260808 23:34:07.859302 4783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:07.839965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:51823)
0808 23:34:07.841530 (+ 1565us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:07.841587 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:07.844095 (+ 2508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:07.845035 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:07.845045 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:07.845724 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:07.846393 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:07.846414 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.847676 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.847680 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:07.849520 (+ 1840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:07.849540 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.850515 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.850525 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:07.850999 (+ 474us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:07.851999 (+ 1000us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:07.852037 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:07.857747 (+ 5710us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1214,"thread_start_us":1003,"threads_started":1}
W20260808 23:34:07.860395 4779 heartbeater.cc:644] Failed to heartbeat to 127.26.207.254:36331 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.207.254:36331: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
I20260808 23:34:07.862076 4496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:07.838660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37406 (local address 127.26.207.254:36331)
0808 23:34:07.838898 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:07.838905 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:07.842843 (+ 3938us) server_negotiation.cc:407] Connection header received
0808 23:34:07.843046 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:07.843055 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:07.843209 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:07.843395 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:07.845445 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.846302 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.847709 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.848190 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.848356 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:07.852817 (+ 4461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:07.852834 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:07.852858 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:07.852916 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:07.857554 (+ 4638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:07.858486 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:07.858499 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:07.858509 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:07.858785 (+ 276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:07.859277 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:07.859282 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:07.859285 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:07.859996 (+ 711us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:07.860359 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:07.861199 (+ 840us) server_negotiation.cc:299] Negotiation successful
0808 23:34:07.861703 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
Aug 08 23:34:07 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:07 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:07.869154 4784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:07.852189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:52131)
0808 23:34:07.854486 (+ 2297us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:07.854510 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:07.854662 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:07.855418 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:07.855427 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:07.856064 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:07.856349 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:07.856368 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.859251 (+ 2883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.859259 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:07.860795 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:07.860862 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.863083 (+ 2221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.863091 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:07.863303 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:07.864106 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:07.864127 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:07.868762 (+ 4635us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":2152,"thread_start_us":2015,"threads_started":1}
W20260808 23:34:07.869692 4785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:07.852335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:52131 (local address 127.26.207.254:36331)
0808 23:34:07.853016 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:07.853033 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:07.854772 (+ 1739us) server_negotiation.cc:407] Connection header received
0808 23:34:07.854867 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:07.854874 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:07.854958 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:07.855073 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:07.856651 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.859075 (+ 2424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.861712 (+ 2637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.862818 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.863010 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:07.869290 (+ 6280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:52131: BlockingRecv error: recv got EOF from 127.26.207.193:52131 (error 108)
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":1236,"threads_started":1}
Aug 08 23:34:07 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:07 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:07.877499 4783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:07.861125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:51203)
0808 23:34:07.865963 (+ 4838us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:07.865988 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:07.866145 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:07.866879 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:07.866884 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:07.867382 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:07.867625 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:07.867644 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.869163 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.869169 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:07.870485 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:07.870501 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.872082 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.872089 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:07.872288 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:07.873188 (+ 900us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:07.873217 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:07.877250 (+ 4033us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":4605,"thread_start_us":5308,"threads_started":1}
W20260808 23:34:07.877858 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:07.861230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:51203 (local address 127.26.207.254:36331)
0808 23:34:07.861822 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:07.861828 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:07.866092 (+ 4264us) server_negotiation.cc:407] Connection header received
0808 23:34:07.866307 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:07.866315 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:07.866705 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:07.866837 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:07.867831 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.868953 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.870884 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.871784 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.871938 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:07.877555 (+ 5617us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:51203: BlockingRecv error: recv got EOF from 127.26.207.195:51203 (error 108)
Metrics: {"server-negotiator.queue_time_us":462}
Aug 08 23:34:07 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:07 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:07.887708 4783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:07.878375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:41687)
0808 23:34:07.878596 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:07.878622 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:07.878753 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:07.879263 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:07.879268 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:07.879748 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:07.879973 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:07.879983 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.881507 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.881512 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:07.882522 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:07.882537 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.883343 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.883347 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:07.883540 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:07.884190 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:07.884210 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:07.887440 (+ 3230us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":68}
W20260808 23:34:07.888052 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:07.878523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:41687 (local address 127.26.207.254:36331)
0808 23:34:07.878682 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:07.878687 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:07.878705 (+ 18us) server_negotiation.cc:407] Connection header received
0808 23:34:07.878901 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:07.878907 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:07.879056 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:07.879155 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:07.880170 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.881331 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.882703 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:07.883158 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:07.883272 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:07.887730 (+ 4458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:41687: BlockingRecv error: recv got EOF from 127.26.207.195:41687 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260808 23:34:07.888206 4779 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 23:34:08 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:08 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:08.382423 4787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:08.371655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:57165)
0808 23:34:08.372369 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:08.372391 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:08.372528 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:08.372960 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:08.372965 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:08.373476 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:08.373682 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:08.373693 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:08.375402 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:08.375406 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:08.376535 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:08.376552 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:08.377841 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:08.377846 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:08.377994 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:08.378786 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:08.378806 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:08.382092 (+ 3286us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":445,"threads_started":1}
W20260808 23:34:08.383212 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:08.371692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:57165 (local address 127.26.207.254:36331)
0808 23:34:08.371898 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:08.371907 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:08.372503 (+ 596us) server_negotiation.cc:407] Connection header received
0808 23:34:08.372637 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:08.372646 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:08.372760 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:08.372915 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:08.373861 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:08.375223 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:08.376727 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:08.377605 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:08.377770 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:08.382465 (+ 4695us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:57165: BlockingRecv error: recv got EOF from 127.26.207.194:57165 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 08 23:34:08 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:08 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:08.879841 4788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:08.870439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:54939)
0808 23:34:08.871039 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:08.871056 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:08.871241 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:08.871627 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:08.871633 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:08.872087 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:08.872267 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:08.872277 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:08.873491 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:08.873496 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:08.874526 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:08.874542 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:08.875315 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:08.875322 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:08.875505 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:08.876170 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:08.876189 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:08.879467 (+ 3278us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":325,"threads_started":1}
W20260808 23:34:08.880010 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:08.870579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:54939 (local address 127.26.207.254:36331)
0808 23:34:08.870822 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:08.870831 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:08.871153 (+ 322us) server_negotiation.cc:407] Connection header received
0808 23:34:08.871407 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:08.871411 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:08.871477 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:08.871590 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:08.872437 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:08.873310 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:08.874701 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:08.875126 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:08.875271 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:08.879774 (+ 4503us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:54939: BlockingRecv error: recv got EOF from 127.26.207.193:54939 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 08 23:34:08 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:08 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:08.898942 4789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:08.889063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:57223)
0808 23:34:08.889542 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:08.889561 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:08.889698 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:08.890031 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:08.890034 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:08.890523 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:08.890727 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:08.890735 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:08.891744 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:08.891747 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:08.893304 (+ 1557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:08.893323 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:08.894542 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:08.894547 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:08.894680 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:08.895286 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:08.895306 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:08.898579 (+ 3273us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":265,"threads_started":1}
W20260808 23:34:08.899163 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:08.889132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:57223 (local address 127.26.207.254:36331)
0808 23:34:08.889386 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:08.889408 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:08.889656 (+ 248us) server_negotiation.cc:407] Connection header received
0808 23:34:08.889806 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:08.889810 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:08.889888 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:08.889983 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:08.890860 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:08.891610 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:08.893538 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:08.894318 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:08.894471 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:08.898855 (+ 4384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:57223: BlockingRecv error: recv got EOF from 127.26.207.195:57223 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 08 23:34:09 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:09 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:09.393277 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:09.383640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:43841)
0808 23:34:09.384243 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:09.384268 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:09.384414 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:09.384746 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:09.384750 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:09.385245 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:09.385448 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:09.385460 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:09.386656 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:09.386661 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:09.387628 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:09.387644 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:09.388439 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:09.388444 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:09.388579 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:09.389273 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:09.389292 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:09.392903 (+ 3611us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":344,"threads_started":1}
W20260808 23:34:09.393461 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:09.383792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:43841 (local address 127.26.207.254:36331)
0808 23:34:09.383973 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:09.383978 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:09.384361 (+ 383us) server_negotiation.cc:407] Connection header received
0808 23:34:09.384529 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:09.384532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:09.384599 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:09.384691 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:09.385658 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:09.386469 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:09.387804 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:09.388235 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:09.388338 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:09.393150 (+ 4812us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:43841: BlockingRecv error: recv got EOF from 127.26.207.194:43841 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 23:34:09 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:09 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 23:34:09.890530 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:09.881539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:40309 (local address 127.26.207.254:36331)
0808 23:34:09.881759 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:09.881765 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:09.881868 (+ 103us) server_negotiation.cc:407] Connection header received
0808 23:34:09.882135 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:09.882140 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:09.882211 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:09.882319 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:09.883083 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:09.883806 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:09.885115 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:09.885570 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:09.885712 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:09.890342 (+ 4630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:40309: BlockingRecv error: recv got EOF from 127.26.207.193:40309 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 23:34:09.890569 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:09.881048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:40309)
0808 23:34:09.881767 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:09.881788 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:09.881976 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:09.882357 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:09.882362 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:09.882762 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:09.882925 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:09.882936 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:09.883959 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:09.883965 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:09.884963 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:09.884976 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:09.885732 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:09.885738 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:09.885932 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:09.886596 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:09.886615 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:09.890054 (+ 3439us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":721,"threads_started":1}
Aug 08 23:34:09 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:09 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:09.911721 4792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:09.900073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:45887)
0808 23:34:09.900758 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:09.900804 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:09.900985 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:09.901639 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:09.901644 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:09.902149 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:09.902350 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:09.902360 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:09.904167 (+ 1807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:09.904172 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:09.905264 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:09.905278 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:09.906209 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:09.906219 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:09.906464 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:09.907535 (+ 1071us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:09.907566 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:09.911338 (+ 3772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":317,"threads_started":1}
W20260808 23:34:09.911880 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:09.900134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:45887 (local address 127.26.207.254:36331)
0808 23:34:09.900340 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:09.900348 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:09.900917 (+ 569us) server_negotiation.cc:407] Connection header received
0808 23:34:09.901201 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:09.901209 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:09.901387 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:09.901539 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:09.902530 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:09.903969 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:09.905435 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:09.905980 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:09.906165 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:09.911600 (+ 5435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:45887: BlockingRecv error: recv got EOF from 127.26.207.195:45887 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 23:34:10 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:10 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:10.403890 4793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:10.394367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:36749)
0808 23:34:10.394960 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:10.394984 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:10.395113 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:10.395493 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:10.395496 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:10.395872 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:10.396083 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:10.396093 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:10.397304 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:10.397308 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:10.398268 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:10.398281 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:10.399034 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:10.399038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:10.399181 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:10.399876 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:10.399895 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:10.403523 (+ 3628us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":313,"threads_started":1}
W20260808 23:34:10.404124 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:10.394462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:36749 (local address 127.26.207.254:36331)
0808 23:34:10.394640 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:10.394644 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:10.395068 (+ 424us) server_negotiation.cc:407] Connection header received
0808 23:34:10.395266 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:10.395270 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:10.395339 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:10.395439 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:10.396249 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:10.397161 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:10.398420 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:10.398880 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:10.398995 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:10.403821 (+ 4826us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:36749: BlockingRecv error: recv got EOF from 127.26.207.194:36749 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 08 23:34:10 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:10 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:10.901049 4795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:10.891707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:38207)
0808 23:34:10.892240 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:10.892257 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:10.892381 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:10.892708 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:10.892711 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:10.893138 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:10.893294 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:10.893304 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:10.894435 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:10.894440 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:10.895440 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:10.895454 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:10.896215 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:10.896219 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:10.896349 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:10.897105 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:10.897124 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:10.900577 (+ 3453us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":296,"threads_started":1}
W20260808 23:34:10.901175 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:10.891830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:38207 (local address 127.26.207.254:36331)
0808 23:34:10.892096 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:10.892103 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:10.892341 (+ 238us) server_negotiation.cc:407] Connection header received
0808 23:34:10.892492 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:10.892496 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:10.892561 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:10.892643 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:10.893466 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:10.894268 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:10.895613 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:10.896057 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:10.896166 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:10.900885 (+ 4719us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:38207: BlockingRecv error: recv got EOF from 127.26.207.193:38207 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 08 23:34:10 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:10 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:10.922850 4796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:10.913146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:42035)
0808 23:34:10.913748 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:10.913765 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:10.913959 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:10.914390 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:10.914396 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:10.914918 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:10.915183 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:10.915198 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:10.916295 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:10.916301 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:10.917355 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:10.917370 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:10.918160 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:10.918166 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:10.918368 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:10.919110 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:10.919130 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:10.922567 (+ 3437us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":343,"threads_started":1}
W20260808 23:34:10.923348 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:10.913271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:42035 (local address 127.26.207.254:36331)
0808 23:34:10.913579 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:10.913586 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:10.913873 (+ 287us) server_negotiation.cc:407] Connection header received
0808 23:34:10.914132 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:10.914136 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:10.914225 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:10.914346 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:10.915323 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:10.916132 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:10.917529 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:10.917964 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:10.918122 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:10.922864 (+ 4742us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:42035: BlockingRecv error: recv got EOF from 127.26.207.195:42035 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 08 23:34:11 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:11 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:11.420344 4797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:11.405316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:46585)
0808 23:34:11.405923 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:11.405946 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:11.406080 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:11.406478 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:11.406482 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:11.406883 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:11.407050 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:11.407059 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:11.408197 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:11.408202 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:11.409388 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:11.409405 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:11.410675 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:11.410681 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:11.410832 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:11.416499 (+ 5667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:11.416532 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:11.420080 (+ 3548us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":355,"threads_started":1}
W20260808 23:34:11.420533 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:11.405313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:46585 (local address 127.26.207.254:36331)
0808 23:34:11.405521 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:11.405527 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:11.406062 (+ 535us) server_negotiation.cc:407] Connection header received
0808 23:34:11.406174 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:11.406178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:11.406245 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:11.406341 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:11.407208 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:11.408039 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:11.409559 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:11.410405 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:11.410609 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:11.420283 (+ 9674us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:46585: BlockingRecv error: recv got EOF from 127.26.207.194:46585 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 08 23:34:11 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:11 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:11.911453 4798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:11.902437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:53759)
0808 23:34:11.903053 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:11.903070 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:11.903257 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:11.903658 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:11.903662 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:11.904115 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:11.904283 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:11.904292 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:11.905523 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:11.905527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:11.906498 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:11.906513 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:11.907257 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:11.907261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:11.907401 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:11.908094 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:11.908114 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:11.911192 (+ 3078us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":323,"threads_started":1}
W20260808 23:34:11.911722 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:11.902489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:53759 (local address 127.26.207.254:36331)
0808 23:34:11.902700 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:11.902706 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:11.903193 (+ 487us) server_negotiation.cc:407] Connection header received
0808 23:34:11.903430 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:11.903434 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:11.903500 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:11.903607 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:11.904438 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:11.905379 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:11.906650 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:11.907104 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:11.907208 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:11.911445 (+ 4237us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:53759: BlockingRecv error: recv got EOF from 127.26.207.193:53759 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 08 23:34:11 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:11 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:11.933650 4799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:11.924092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:60929)
0808 23:34:11.924817 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:11.924840 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:11.924986 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:11.925508 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:11.925512 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:11.926045 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:11.926213 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:11.926222 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:11.927486 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:11.927493 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:11.928509 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:11.928522 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:11.929298 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:11.929302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:11.929446 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:11.930068 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:11.930088 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:11.933407 (+ 3319us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":421,"threads_started":1}
W20260808 23:34:11.934162 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:11.924193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:60929 (local address 127.26.207.254:36331)
0808 23:34:11.924412 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:11.924417 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:11.924944 (+ 527us) server_negotiation.cc:407] Connection header received
0808 23:34:11.925153 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:11.925157 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:11.925325 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:11.925454 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:11.926348 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:11.927278 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:11.928655 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:11.929157 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:11.929260 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:11.933671 (+ 4411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:60929: BlockingRecv error: recv got EOF from 127.26.207.195:60929 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 08 23:34:12 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:12 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:12.431377 4800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:12.421582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:43543)
0808 23:34:12.422373 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:12.422400 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:12.422579 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:12.423057 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:12.423068 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:12.423701 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:12.423949 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:12.423962 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:12.425313 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:12.425317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:12.426267 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:12.426282 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:12.427059 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:12.427064 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:12.427211 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:12.427933 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:12.427952 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:12.431104 (+ 3152us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":499,"threads_started":1}
W20260808 23:34:12.431628 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:12.421829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:43543 (local address 127.26.207.254:36331)
0808 23:34:12.422005 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:12.422010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:12.422512 (+ 502us) server_negotiation.cc:407] Connection header received
0808 23:34:12.422750 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:12.422755 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:12.422847 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:12.422961 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:12.424175 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:12.425148 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:12.426449 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:12.426876 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:12.427000 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:12.431368 (+ 4368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:43543: BlockingRecv error: recv got EOF from 127.26.207.194:43543 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 08 23:34:12 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:12 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:12.923158 4801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:12.912698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:58585)
0808 23:34:12.913634 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:12.913656 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:12.913842 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:12.914228 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:12.914233 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:12.914676 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:12.914840 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:12.914849 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:12.915993 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:12.915999 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:12.917567 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:12.917586 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:12.918888 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:12.918901 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:12.919127 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:12.919803 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:12.919821 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:12.922916 (+ 3095us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":817,"thread_start_us":660,"threads_started":1}
W20260808 23:34:12.923456 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:12.912930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:58585 (local address 127.26.207.254:36331)
0808 23:34:12.913194 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:12.913204 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:12.913769 (+ 565us) server_negotiation.cc:407] Connection header received
0808 23:34:12.913995 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:12.914001 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:12.914082 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:12.914194 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:12.915006 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:12.915820 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:12.918005 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:12.918696 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:12.918832 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:12.923192 (+ 4360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:58585: BlockingRecv error: recv got EOF from 127.26.207.193:58585 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 08 23:34:12 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:12 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:12.944026 4802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:12.934709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:54129)
0808 23:34:12.935236 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:12.935252 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:12.935374 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:12.935694 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:12.935697 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:12.936118 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:12.936282 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:12.936291 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:12.937407 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:12.937411 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:12.938345 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:12.938357 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:12.939117 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:12.939121 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:12.939256 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:12.939881 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:12.939901 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:12.943668 (+ 3767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":283,"threads_started":1}
W20260808 23:34:12.944275 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:12.934804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:54129 (local address 127.26.207.254:36331)
0808 23:34:12.935065 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:12.935071 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:12.935341 (+ 270us) server_negotiation.cc:407] Connection header received
0808 23:34:12.935484 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:12.935488 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:12.935567 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:12.935652 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:12.936415 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:12.937265 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:12.938513 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:12.938977 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:12.939083 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:12.944013 (+ 4930us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:54129: BlockingRecv error: recv got EOF from 127.26.207.195:54129 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 08 23:34:13 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:13 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:13.442689 4803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:13.432573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:45123)
0808 23:34:13.433516 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:13.433539 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:13.433710 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:13.434125 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:13.434130 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:13.434582 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:13.434746 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:13.434756 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:13.435866 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:13.435872 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:13.436859 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:13.436874 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:13.437701 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:13.437707 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:13.437898 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:13.438608 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:13.438627 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:13.442280 (+ 3653us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":835,"thread_start_us":494,"threads_started":1}
W20260808 23:34:13.442921 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:13.432624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:45123 (local address 127.26.207.254:36331)
0808 23:34:13.432912 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:13.432920 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:13.433632 (+ 712us) server_negotiation.cc:407] Connection header received
0808 23:34:13.433869 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:13.433874 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:13.433950 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:13.434060 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:13.434923 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:13.435693 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:13.437036 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:13.437507 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:13.437654 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:13.442610 (+ 4956us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:45123: BlockingRecv error: recv got EOF from 127.26.207.194:45123 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
Aug 08 23:34:13 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:13 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:13.933964 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:13.924354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:47819)
0808 23:34:13.925065 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:13.925083 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:13.925227 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:13.925551 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:13.925554 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:13.926008 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:13.926186 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:13.926195 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:13.927300 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:13.927304 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:13.928297 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:13.928311 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:13.929184 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:13.929189 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:13.929311 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:13.929944 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:13.929974 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:13.933607 (+ 3633us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":320,"threads_started":1}
W20260808 23:34:13.934218 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:13.924446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:47819 (local address 127.26.207.254:36331)
0808 23:34:13.924706 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:13.924715 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:13.925181 (+ 466us) server_negotiation.cc:407] Connection header received
0808 23:34:13.925344 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:13.925347 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:13.925414 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:13.925514 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:13.926366 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:13.927145 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:13.928463 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:13.929024 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:13.929135 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:13.933893 (+ 4758us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:47819: BlockingRecv error: recv got EOF from 127.26.207.193:47819 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 08 23:34:13 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:13 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:13.954315 4805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:13.945002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:58277)
0808 23:34:13.945583 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:13.945600 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:13.945780 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:13.946173 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:13.946178 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:13.946616 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:13.946770 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:13.946779 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:13.947944 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:13.947950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:13.948957 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:13.948971 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:13.949743 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:13.949749 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:13.949932 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:13.950621 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:13.950641 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:13.953962 (+ 3321us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":276,"threads_started":1}
W20260808 23:34:13.954531 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:13.945079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:58277 (local address 127.26.207.254:36331)
0808 23:34:13.945287 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:13.945295 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:13.945758 (+ 463us) server_negotiation.cc:407] Connection header received
0808 23:34:13.945931 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:13.945936 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:13.946022 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:13.946135 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:13.946937 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:13.947779 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:13.949119 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:13.949554 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:13.949696 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:13.954250 (+ 4554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:58277: BlockingRecv error: recv got EOF from 127.26.207.195:58277 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 08 23:34:14 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:14 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:14.453270 4806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:14.443993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:37453)
0808 23:34:14.444676 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:14.444699 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:14.444895 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:14.445281 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:14.445286 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:14.445810 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:14.445987 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:14.445997 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:14.447088 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:14.447093 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:14.448039 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:14.448050 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:14.448773 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:14.448831 (+ 58us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:14.449005 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:14.449676 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:14.449695 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:14.452895 (+ 3200us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":303,"threads_started":1}
W20260808 23:34:14.453426 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:14.444079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:37453 (local address 127.26.207.254:36331)
0808 23:34:14.444384 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:14.444393 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:14.444811 (+ 418us) server_negotiation.cc:407] Connection header received
0808 23:34:14.445069 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:14.445072 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:14.445135 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:14.445244 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:14.446149 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:14.446915 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:14.448191 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:14.448609 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:14.448747 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:14.453175 (+ 4428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:37453: BlockingRecv error: recv got EOF from 127.26.207.194:37453 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
Aug 08 23:34:14 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:14 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:14.944327 4807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:14.935058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:50183)
0808 23:34:14.935698 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:14.935714 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:14.935837 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:14.936235 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:14.936242 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:14.936715 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:14.936981 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:14.936997 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:14.938168 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:14.938177 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:14.939122 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:14.939135 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:14.939944 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:14.939951 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:14.940127 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:14.940799 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:14.940820 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:14.943992 (+ 3172us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":374,"threads_started":1}
W20260808 23:34:14.944551 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:14.935171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:50183 (local address 127.26.207.254:36331)
0808 23:34:14.935404 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:14.935410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:14.935807 (+ 397us) server_negotiation.cc:407] Connection header received
0808 23:34:14.936010 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:14.936014 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:14.936080 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:14.936189 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:14.937197 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:14.938006 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:14.939283 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:14.939750 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:14.939897 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:14.944260 (+ 4363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:50183: BlockingRecv error: recv got EOF from 127.26.207.193:50183 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 08 23:34:14 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:14 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:14.964917 4808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:14.955504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:60255)
0808 23:34:14.956191 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:14.956208 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:14.956392 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:14.956822 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:14.956830 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:14.957336 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:14.957524 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:14.957534 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:14.958628 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:14.958633 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:14.959583 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:14.959603 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:14.960526 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:14.960531 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:14.960750 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:14.961509 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:14.961538 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:14.964560 (+ 3022us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":302,"threads_started":1}
W20260808 23:34:14.965107 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:14.955771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:60255 (local address 127.26.207.254:36331)
0808 23:34:14.956039 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:14.956045 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:14.956314 (+ 269us) server_negotiation.cc:407] Connection header received
0808 23:34:14.956532 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:14.956544 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:14.956635 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:14.956752 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:14.957693 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:14.958448 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:14.959746 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:14.960353 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:14.960497 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:14.964840 (+ 4343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:60255: BlockingRecv error: recv got EOF from 127.26.207.195:60255 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Aug 08 23:34:15 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:15 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:15.464525 4809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:15.454611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:56915)
0808 23:34:15.455319 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:15.455362 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:15.455556 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:15.456097 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:15.456103 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:15.456619 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:15.456901 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:15.456915 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:15.458422 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:15.458428 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:15.459487 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:15.459503 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:15.460341 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:15.460346 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:15.460478 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:15.461220 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:15.461240 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:15.464270 (+ 3030us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":361,"threads_started":1}
W20260808 23:34:15.464779 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:15.454775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:56915 (local address 127.26.207.254:36331)
0808 23:34:15.454982 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:15.454989 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:15.455479 (+ 490us) server_negotiation.cc:407] Connection header received
0808 23:34:15.455701 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:15.455706 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:15.455802 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:15.455897 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:15.457058 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:15.458224 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:15.459662 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:15.460116 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:15.460221 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:15.464539 (+ 4318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:56915: BlockingRecv error: recv got EOF from 127.26.207.194:56915 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 23:34:15 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:15 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:15.955173 4810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:15.945562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:50081)
0808 23:34:15.946197 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:15.946215 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:15.946425 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:15.946839 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:15.946844 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:15.947313 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:15.947492 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:15.947511 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:15.948592 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:15.948605 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:15.949621 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:15.949635 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:15.950450 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:15.950457 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:15.950658 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:15.951412 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:15.951432 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:15.954894 (+ 3462us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":348,"threads_started":1}
W20260808 23:34:15.955447 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:15.945695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:50081 (local address 127.26.207.254:36331)
0808 23:34:15.945980 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:15.945988 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:15.946329 (+ 341us) server_negotiation.cc:407] Connection header received
0808 23:34:15.946587 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:15.946597 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:15.946682 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:15.946796 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:15.947681 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:15.948417 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:15.949795 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:15.950267 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:15.950434 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:15.955190 (+ 4756us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:50081: BlockingRecv error: recv got EOF from 127.26.207.193:50081 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 08 23:34:15 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:15 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:15.974797 4811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:15.965853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:49693)
0808 23:34:15.966470 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:15.966487 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:15.966607 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:15.966889 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:15.966892 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:15.967280 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:15.967455 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:15.967464 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:15.968518 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:15.968522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:15.969623 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:15.969639 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:15.970422 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:15.970427 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:15.970556 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:15.971268 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:15.971288 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:15.974431 (+ 3143us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":356,"threads_started":1}
W20260808 23:34:15.975033 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:15.965917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:49693 (local address 127.26.207.254:36331)
0808 23:34:15.966165 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:15.966175 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:15.966567 (+ 392us) server_negotiation.cc:407] Connection header received
0808 23:34:15.966707 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:15.966710 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:15.966772 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:15.966846 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:15.967593 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:15.968353 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:15.969779 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:15.970236 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:15.970344 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:15.974752 (+ 4408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:49693: BlockingRecv error: recv got EOF from 127.26.207.195:49693 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 23:34:16 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:16 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:16.479628 4812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:16.465695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:36819)
0808 23:34:16.466291 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:16.466313 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:16.466512 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:16.466882 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:16.466886 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:16.467340 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:16.467520 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:16.467529 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:16.468591 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:16.468596 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:16.469578 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:16.469591 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:16.470581 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:16.470587 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:16.470808 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:16.475944 (+ 5136us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:16.475968 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:16.479343 (+ 3375us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":341,"threads_started":1}
W20260808 23:34:16.479878 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:16.465841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:36819 (local address 127.26.207.254:36331)
0808 23:34:16.466106 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:16.466114 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:16.466417 (+ 303us) server_negotiation.cc:407] Connection header received
0808 23:34:16.466663 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:16.466668 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:16.466734 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:16.466844 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:16.467682 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:16.468434 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:16.469736 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:16.470359 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:16.470499 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:16.479632 (+ 9133us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:36819: BlockingRecv error: recv got EOF from 127.26.207.194:36819 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 08 23:34:16 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:16 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:16.965323 4813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:16.956222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:38587)
0808 23:34:16.956853 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:16.956870 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:16.957041 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:16.957424 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:16.957427 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:16.957822 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:16.958004 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:16.958014 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:16.959085 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:16.959088 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:16.960049 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:16.960061 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:16.960883 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:16.960889 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:16.961035 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:16.961751 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:16.961770 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:16.965081 (+ 3311us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":361,"threads_started":1}
W20260808 23:34:16.965631 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:16.956278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:38587 (local address 127.26.207.254:36331)
0808 23:34:16.956499 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:16.956508 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:16.956966 (+ 458us) server_negotiation.cc:407] Connection header received
0808 23:34:16.957189 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:16.957196 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:16.957287 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:16.957371 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:16.958143 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:16.958937 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:16.960192 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:16.960646 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:16.960746 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:16.965345 (+ 4599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:38587: BlockingRecv error: recv got EOF from 127.26.207.193:38587 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 23:34:16 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:16 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:16.987118 4814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:16.976013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:50315)
0808 23:34:16.977188 (+ 1175us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:16.977224 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:16.977377 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:16.977862 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:16.977868 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:16.978493 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:16.978749 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:16.978766 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:16.980309 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:16.980318 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:16.981689 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:16.981704 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:16.982694 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:16.982699 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:16.982826 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:16.983433 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:16.983452 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:16.986723 (+ 3271us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1027,"thread_start_us":880,"threads_started":1}
W20260808 23:34:16.987283 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:16.976210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:50315 (local address 127.26.207.254:36331)
0808 23:34:16.976448 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:16.976472 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:16.977337 (+ 865us) server_negotiation.cc:407] Connection header received
0808 23:34:16.977546 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:16.977552 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:16.977666 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:16.977807 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:16.978937 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:16.980034 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:16.981885 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:16.982534 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:16.982639 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:16.987011 (+ 4372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:50315: BlockingRecv error: recv got EOF from 127.26.207.195:50315 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 08 23:34:17 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:17 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:17.490223 4815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:17.480659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:55303)
0808 23:34:17.481260 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:17.481284 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:17.481400 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:17.481709 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:17.481712 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:17.482109 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:17.482264 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:17.482273 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:17.483391 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:17.483395 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:17.484351 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:17.484363 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:17.485234 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:17.485240 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:17.485376 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:17.486036 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:17.486055 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:17.489970 (+ 3915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":362,"threads_started":1}
W20260808 23:34:17.490480 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:17.480831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:55303 (local address 127.26.207.254:36331)
0808 23:34:17.481028 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:17.481033 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:17.481362 (+ 329us) server_negotiation.cc:407] Connection header received
0808 23:34:17.481502 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:17.481506 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:17.481567 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:17.481663 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:17.482442 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:17.483238 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:17.484504 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:17.485050 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:17.485158 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:17.490178 (+ 5020us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:55303: BlockingRecv error: recv got EOF from 127.26.207.194:55303 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 08 23:34:17 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:17 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:17.976091 4816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:17.966380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:45827)
0808 23:34:17.967010 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:17.967031 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:17.967213 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:17.967592 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:17.967598 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:17.968086 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:17.968273 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:17.968284 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:17.969449 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:17.969454 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:17.970378 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:17.970391 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:17.971257 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:17.971263 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:17.971457 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:17.972152 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:17.972171 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:17.975813 (+ 3642us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":330,"threads_started":1}
W20260808 23:34:17.976298 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:17.966668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:45827 (local address 127.26.207.254:36331)
0808 23:34:17.966994 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:17.967001 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:17.967132 (+ 131us) server_negotiation.cc:407] Connection header received
0808 23:34:17.967348 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:17.967353 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:17.967438 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:17.967552 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:17.968443 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:17.969284 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:17.970542 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:17.971045 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:17.971224 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:17.976061 (+ 4837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:45827: BlockingRecv error: recv got EOF from 127.26.207.193:45827 (error 108)
Metrics: {"server-negotiator.queue_time_us":168}
Aug 08 23:34:17 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:17 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:17.997675 4819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:17.988435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:49305)
0808 23:34:17.989003 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:17.989020 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:17.989144 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:17.989714 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:17.989718 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:17.990142 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:17.990301 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:17.990311 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:17.991613 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:17.991618 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:17.992627 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:17.992641 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:17.993470 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:17.993475 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:17.993607 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:17.994262 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:17.994281 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:17.997439 (+ 3158us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":329,"threads_started":1}
W20260808 23:34:17.998135 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:17.988485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:49305 (local address 127.26.207.254:36331)
0808 23:34:17.988681 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:17.988687 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:17.989117 (+ 430us) server_negotiation.cc:407] Connection header received
0808 23:34:17.989252 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:17.989255 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:17.989321 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:17.989623 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:17.990473 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:17.991433 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:17.992852 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:17.993287 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:17.993393 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:17.997783 (+ 4390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:49305: BlockingRecv error: recv got EOF from 127.26.207.195:49305 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 08 23:34:18 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:18 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:18.501055 4820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:18.491245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:46191)
0808 23:34:18.491899 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:18.491942 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:18.492107 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:18.492465 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:18.492469 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:18.492930 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:18.493126 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:18.493136 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:18.494211 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:18.494215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:18.495154 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:18.495167 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:18.496011 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:18.496016 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:18.496149 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:18.496879 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:18.496898 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:18.500698 (+ 3800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":345,"threads_started":1}
W20260808 23:34:18.501238 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:18.491473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:46191 (local address 127.26.207.254:36331)
0808 23:34:18.491728 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:18.491735 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:18.492078 (+ 343us) server_negotiation.cc:407] Connection header received
0808 23:34:18.492228 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:18.492231 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:18.492298 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:18.492385 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:18.493297 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:18.494063 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:18.495332 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:18.495814 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:18.495957 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:18.501027 (+ 5070us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:46191: BlockingRecv error: recv got EOF from 127.26.207.194:46191 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 08 23:34:18 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:18 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:18.986682 4821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:18.977268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:58495)
0808 23:34:18.977958 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:18.977981 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:18.978148 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:18.978556 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:18.978560 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:18.979009 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:18.979175 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:18.979185 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:18.980278 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:18.980283 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:18.981362 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:18.981377 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:18.982203 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:18.982214 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:18.982364 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:18.983050 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:18.983068 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:18.986419 (+ 3351us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":432,"threads_started":1}
W20260808 23:34:18.986999 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:18.977311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:58495 (local address 127.26.207.254:36331)
0808 23:34:18.977567 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:18.977577 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:18.978073 (+ 496us) server_negotiation.cc:407] Connection header received
0808 23:34:18.978314 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:18.978319 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:18.978406 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:18.978489 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:18.979328 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:18.980129 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:18.981560 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:18.982026 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:18.982143 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:18.986712 (+ 4569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:58495: BlockingRecv error: recv got EOF from 127.26.207.193:58495 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 08 23:34:19 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:19 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:19.009322 4822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:18.998955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:58187)
0808 23:34:18.999604 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:18.999622 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:18.999849 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:19.000266 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:19.000271 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:19.000762 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:19.001034 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:19.001046 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:19.002627 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:19.002633 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:19.003613 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:19.003629 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:19.004453 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:19.004459 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:19.004661 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:19.005592 (+ 931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:19.005614 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:19.009045 (+ 3431us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":369,"threads_started":1}
W20260808 23:34:19.009663 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:18.999129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:58187 (local address 127.26.207.254:36331)
0808 23:34:18.999417 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:18.999424 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:18.999753 (+ 329us) server_negotiation.cc:407] Connection header received
0808 23:34:19.000032 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:19.000036 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:19.000108 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:19.000223 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:19.001206 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:19.002433 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:19.003789 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:19.004264 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:19.004426 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:19.009331 (+ 4905us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:58187: BlockingRecv error: recv got EOF from 127.26.207.195:58187 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
Aug 08 23:34:19 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:19 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:19.511664 4823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:19.502388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:36177)
0808 23:34:19.502970 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:19.502995 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:19.503120 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:19.503476 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:19.503479 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:19.503934 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:19.504104 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:19.504113 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:19.505219 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:19.505224 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:19.506186 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:19.506202 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:19.507059 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:19.507064 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:19.507226 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:19.507952 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:19.507972 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:19.511416 (+ 3444us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":345,"threads_started":1}
W20260808 23:34:19.512049 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:19.502472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:36177 (local address 127.26.207.254:36331)
0808 23:34:19.502863 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:19.502867 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:19.503080 (+ 213us) server_negotiation.cc:407] Connection header received
0808 23:34:19.503225 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:19.503229 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:19.503324 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:19.503414 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:19.504252 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:19.505071 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:19.506385 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:19.506890 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:19.507007 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:19.511723 (+ 4716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:36177: BlockingRecv error: recv got EOF from 127.26.207.194:36177 (error 108)
Metrics: {"server-negotiator.queue_time_us":263}
Aug 08 23:34:19 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:19 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:19.997229 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:19.987940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:46159)
0808 23:34:19.988526 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:19.988551 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:19.988733 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:19.989179 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:19.989184 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:19.989653 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:19.989823 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:19.989834 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:19.990917 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:19.990923 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:19.991897 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:19.991909 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:19.992700 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:19.992709 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:19.992920 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:19.993579 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:19.993598 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:19.996957 (+ 3359us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":297,"threads_started":1}
W20260808 23:34:19.997684 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:19.988045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:46159 (local address 127.26.207.254:36331)
0808 23:34:19.988306 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:19.988316 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:19.988658 (+ 342us) server_negotiation.cc:407] Connection header received
0808 23:34:19.988944 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:19.988948 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:19.989015 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:19.989137 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:19.989992 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:19.990750 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:19.992066 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:19.992487 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:19.992629 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:19.997224 (+ 4595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:46159: BlockingRecv error: recv got EOF from 127.26.207.193:46159 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 08 23:34:20 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:20 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:20.019848 4825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:20.010461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:35759)
0808 23:34:20.011091 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:20.011110 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:20.011252 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:20.011620 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:20.011623 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:20.012191 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:20.012378 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:20.012388 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:20.013553 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:20.013557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:20.014486 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:20.014498 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:20.015256 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:20.015263 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:20.015427 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:20.016182 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:20.016204 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:20.019562 (+ 3358us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":385,"threads_started":1}
W20260808 23:34:20.020295 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:20.010584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:35759 (local address 127.26.207.254:36331)
0808 23:34:20.010792 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:20.010797 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:20.011218 (+ 421us) server_negotiation.cc:407] Connection header received
0808 23:34:20.011369 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:20.011373 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:20.011443 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:20.011547 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:20.012535 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:20.013398 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:20.014619 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:20.015048 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:20.015145 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:20.019824 (+ 4679us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:35759: BlockingRecv error: recv got EOF from 127.26.207.195:35759 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 08 23:34:20 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:20 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:20.522500 4826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:20.512913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:32861)
0808 23:34:20.513491 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:20.513514 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:20.513647 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:20.514023 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:20.514026 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:20.514445 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:20.514622 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:20.514658 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:20.515770 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:20.515774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:20.516726 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:20.516740 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:20.517619 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:20.517623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:20.517805 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:20.518516 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:20.518535 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:20.522115 (+ 3580us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":298,"threads_started":1}
W20260808 23:34:20.522663 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:20.513151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:32861 (local address 127.26.207.254:36331)
0808 23:34:20.513413 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:20.513422 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:20.513603 (+ 181us) server_negotiation.cc:407] Connection header received
0808 23:34:20.513766 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:20.513770 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:20.513842 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:20.513962 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:20.514824 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:20.515615 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:20.516977 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:20.517464 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:20.517597 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:20.522337 (+ 4740us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:32861: BlockingRecv error: recv got EOF from 127.26.207.194:32861 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 08 23:34:21 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:21 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:21.008980 4827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:20.998394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:58551)
0808 23:34:20.998980 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:20.999001 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:20.999202 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:20.999574 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:20.999579 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:21.000015 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:21.000205 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:21.000215 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:21.001430 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:21.001435 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:21.002373 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:21.002395 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:21.003199 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:21.003204 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:21.003345 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:21.004075 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:21.004094 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:21.008624 (+ 4530us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":303,"threads_started":1}
W20260808 23:34:21.009177 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:20.998493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:58551 (local address 127.26.207.254:36331)
0808 23:34:20.998801 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:20.998809 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:20.999122 (+ 313us) server_negotiation.cc:407] Connection header received
0808 23:34:20.999355 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:20.999360 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:20.999426 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:20.999556 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:21.000401 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:21.001246 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:21.002537 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:21.003023 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:21.003127 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:21.008946 (+ 5819us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:58551: BlockingRecv error: recv got EOF from 127.26.207.193:58551 (error 108)
Metrics: {"server-negotiator.queue_time_us":115}
Aug 08 23:34:21 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:21 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:21.030210 4828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:21.021056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:55891)
0808 23:34:21.021638 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:21.021654 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:21.021821 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:21.022170 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:21.022175 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:21.022644 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:21.022807 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:21.022815 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:21.023851 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:21.023856 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:21.024888 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:21.024902 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:21.025681 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:21.025686 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:21.025856 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:21.026564 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:21.026582 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:21.029910 (+ 3328us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":314,"threads_started":1}
W20260808 23:34:21.030608 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:21.021098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:55891 (local address 127.26.207.254:36331)
0808 23:34:21.021441 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:21.021448 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:21.021743 (+ 295us) server_negotiation.cc:407] Connection header received
0808 23:34:21.021954 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:21.021960 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:21.022031 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:21.022137 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:21.022967 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:21.023705 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:21.025040 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:21.025483 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:21.025624 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:21.030189 (+ 4565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:55891: BlockingRecv error: recv got EOF from 127.26.207.195:55891 (error 108)
Metrics: {"server-negotiator.queue_time_us":194}
Aug 08 23:34:21 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:21 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:21.538113 4829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:21.523873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:55817)
0808 23:34:21.524417 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:21.524439 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:21.524573 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:21.524910 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:21.524914 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:21.525301 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:21.525491 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:21.525501 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:21.526596 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:21.526600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:21.527616 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:21.527632 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:21.528459 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:21.528464 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:21.528604 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:21.534301 (+ 5697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:21.534325 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:21.537849 (+ 3524us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":284,"threads_started":1}
W20260808 23:34:21.538453 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:21.523962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:55817 (local address 127.26.207.254:36331)
0808 23:34:21.524243 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:21.524250 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:21.524531 (+ 281us) server_negotiation.cc:407] Connection header received
0808 23:34:21.524685 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:21.524689 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:21.524757 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:21.524870 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:21.525676 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:21.526449 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:21.527783 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:21.528291 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:21.528402 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:21.538137 (+ 9735us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:55817: BlockingRecv error: recv got EOF from 127.26.207.194:55817 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 08 23:34:22 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:22 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.193@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:22.019424 4830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:22.010555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.193:59923)
0808 23:34:22.011188 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:22.011205 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:22.011327 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:22.011637 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:22.011640 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:22.012072 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:22.012244 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:22.012254 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.013411 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.013416 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:22.014402 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:22.014416 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.015111 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.015115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:22.015240 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:22.015865 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:22.015883 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:22.019025 (+ 3142us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":361,"threads_started":1}
W20260808 23:34:22.019587 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:22.010585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:59923 (local address 127.26.207.254:36331)
0808 23:34:22.010765 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:22.010769 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:22.011293 (+ 524us) server_negotiation.cc:407] Connection header received
0808 23:34:22.011423 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:22.011426 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:22.011490 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:22.011582 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:22.012381 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.013243 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.014550 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.014979 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.015078 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:22.019268 (+ 4190us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.193:59923: BlockingRecv error: recv got EOF from 127.26.207.193:59923 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 23:34:22 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:22 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.195@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:22.040585 4831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:22.031444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.195:58323)
0808 23:34:22.032095 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:22.032113 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:22.032244 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:22.032618 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:22.032621 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:22.033172 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:22.033362 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:22.033372 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.034725 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.034731 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:22.035772 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:22.035787 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.036520 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.036525 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:22.036664 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:22.037347 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:22.037366 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:22.040300 (+ 2934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":406,"threads_started":1}
W20260808 23:34:22.040805 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:22.031582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:58323 (local address 127.26.207.254:36331)
0808 23:34:22.031792 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:22.031797 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:22.032194 (+ 397us) server_negotiation.cc:407] Connection header received
0808 23:34:22.032350 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:22.032354 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:22.032420 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:22.032526 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:22.033522 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.034553 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.035917 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.036378 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.036485 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:22.040554 (+ 4069us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.195:58323: BlockingRecv error: recv got EOF from 127.26.207.195:58323 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 08 23:34:22 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 23:34:22 dist-test-slave-1x4g krb5kdc[3717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.207.194@KRBTEST.COM for oryx/127.26.207.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 23:34:22.548887 4832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:22.539614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36331 (local address 127.26.207.194:46843)
0808 23:34:22.540332 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:22.540360 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:22.540528 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:22.541073 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:22.541081 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:22.541585 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:22.541762 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:22.541772 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.542782 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.542786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:22.543758 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:22.543771 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.544628 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.544632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:22.544751 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:22.545464 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:22.545482 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:22.548554 (+ 3072us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.207.254:36331: Server oryx/127.26.207.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":434,"threads_started":1}
W20260808 23:34:22.549153 4782 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:22.539649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:46843 (local address 127.26.207.254:36331)
0808 23:34:22.539884 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:22.539890 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:22.540458 (+ 568us) server_negotiation.cc:407] Connection header received
0808 23:34:22.540736 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:22.540761 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:22.540893 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:22.541017 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:22.541898 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.542630 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.543941 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.544437 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.544542 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:22.548900 (+ 4358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.207.194:46843: BlockingRecv error: recv got EOF from 127.26.207.194:46843 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 23:34:22.842164 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 4337
I20260808 23:34:22.861593 4834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:22.843501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32770 (local address 127.26.207.193:41503)
0808 23:34:22.844125 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:22.844132 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:22.844161 (+ 29us) server_negotiation.cc:407] Connection header received
0808 23:34:22.844228 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:22.844235 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:22.844480 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:22.844673 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:22.846360 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.847378 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.848715 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.849394 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.849501 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:22.858017 (+ 8516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:22.858028 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:22.858045 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:22.858093 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:22.861011 (+ 2918us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.207.193@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 23:34:22.861348 (+ 337us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:32770: Request ticket server kudu/127.26.207.193@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":281,"threads_started":1}
W20260808 23:34:22.861687 4834 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:32770: Request ticket server kudu/127.26.207.193@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 23:34:22.861969 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 4337: Not authorized: Client connection negotiation failed: client connection to 127.26.207.193:41503: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.207.193@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 23:34:22.862215 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 4337
I20260808 23:34:22.885511 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 4498
I20260808 23:34:22.898844 4835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:22.886700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57578 (local address 127.26.207.194:46599)
0808 23:34:22.887379 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:22.887386 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:22.887420 (+ 34us) server_negotiation.cc:407] Connection header received
0808 23:34:22.887492 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:22.887498 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:22.887724 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:22.887883 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:22.889377 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.890543 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.891854 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.892468 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.892575 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:22.895348 (+ 2773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:22.895359 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:22.895374 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:22.895421 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:22.898223 (+ 2802us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.207.194@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 23:34:22.898546 (+ 323us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57578: Request ticket server kudu/127.26.207.194@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":325,"threads_started":1}
W20260808 23:34:22.898975 4835 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57578: Request ticket server kudu/127.26.207.194@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 23:34:22.899137 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 4498: Not authorized: Client connection negotiation failed: client connection to 127.26.207.194:46599: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.207.194@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 23:34:22.899312 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 4498
I20260808 23:34:22.922282 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 4640
I20260808 23:34:22.940955 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:22.923697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42436 (local address 127.26.207.195:42251)
0808 23:34:22.924415 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:22.924426 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:22.924462 (+ 36us) server_negotiation.cc:407] Connection header received
0808 23:34:22.924561 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:22.924573 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:22.924947 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:22.925178 (+ 231us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:22.927278 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.928835 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.930784 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:22.931938 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:22.932115 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:22.936279 (+ 4164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:22.936292 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:22.936313 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:22.936408 (+ 95us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:22.940128 (+ 3720us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.207.195@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 23:34:22.940564 (+ 436us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42436: Request ticket server kudu/127.26.207.195@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":375,"threads_started":1}
W20260808 23:34:22.941082 4836 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42436: Request ticket server kudu/127.26.207.195@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 23:34:22.941159 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 4640: Not authorized: Client connection negotiation failed: client connection to 127.26.207.195:42251: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.207.195@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 23:34:22.941368 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 4640
I20260808 23:34:22.968602 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 4264
I20260808 23:34:22.970294 4329 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:23.098317 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 4264
2026-08-08T23:34:23Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22139 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T23:34:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:34:23Z Disabled control of system clock
I20260808 23:34:23.200031 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:38709
--webserver_interface=127.26.207.254
--webserver_port=0
--builtin_ntp_servers=127.26.207.212:39737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:38709
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 23:34:23.574162 4841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:23.574504 4841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:23.574586 4841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:23.582561 4841 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:34:23.582701 4841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:23.582741 4841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:23.582794 4841 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:34:23.582834 4841 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:34:23.593330 4841 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:39737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:38709
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:38709
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:23.594744 4841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:23.596716 4841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:23.610244 4848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:23.610324 4850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:23.610222 4846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:23.611686 4841 server_base.cc:1034] running on GCE node
I20260808 23:34:23.612663 4841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:23.614449 4841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:23.615741 4841 hybrid_clock.cc:648] HybridClock initialized: now 1786232063615688 us; error 55 us; skew 500 ppm
I20260808 23:34:23.616181 4841 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:34:23.619005 4841 webserver.cc:460] Webserver started at http://127.26.207.254:38991/ using document root <none> and password file <none>
I20260808 23:34:23.619832 4841 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:23.619982 4841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:23.620342 4841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:34:23.623714 4841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "c79749d1970248859278d4b2b5a715a4"
format_stamp: "Formatted at 2026-08-08 23:34:23 on dist-test-slave-1x4g"
server_key: "66506507a07f8c294004d1260e889dd0"
server_key_iv: "26df77c29d252cbee741e4ae6303a9f9"
server_key_version: "encryptionkey@0"
I20260808 23:34:23.624634 4841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "c79749d1970248859278d4b2b5a715a4"
format_stamp: "Formatted at 2026-08-08 23:34:23 on dist-test-slave-1x4g"
server_key: "66506507a07f8c294004d1260e889dd0"
server_key_iv: "26df77c29d252cbee741e4ae6303a9f9"
server_key_version: "encryptionkey@0"
I20260808 23:34:23.630483 4841 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 23:34:23.634649 4858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:23.636286 4841 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 23:34:23.636530 4841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "c79749d1970248859278d4b2b5a715a4"
format_stamp: "Formatted at 2026-08-08 23:34:23 on dist-test-slave-1x4g"
server_key: "66506507a07f8c294004d1260e889dd0"
server_key_iv: "26df77c29d252cbee741e4ae6303a9f9"
server_key_version: "encryptionkey@0"
I20260808 23:34:23.636863 4841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:23.655833 4841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:23.656941 4841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:23.657272 4841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:23.680763 4841 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:38709
I20260808 23:34:23.680929 4912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:38709 every 8 connection(s)
I20260808 23:34:23.682559 4841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:34:23.683966 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 4841
I20260808 23:34:23.684230 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:34:23.685130 27455 external_mini_cluster.cc:1428] Setting key 4c7a4f2d8a55a6036a2efb0c24a2b7fa
I20260808 23:34:23.688300 4914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:34:23.701061 4914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4: Bootstrap starting.
I20260808 23:34:23.701185 4917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:23.687496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39552 (local address 127.26.207.254:38709)
0808 23:34:23.688761 (+ 1265us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:23.688814 (+ 53us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:23.688913 (+ 99us) server_negotiation.cc:407] Connection header received
0808 23:34:23.690749 (+ 1836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:23.690777 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:23.691343 (+ 566us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:23.691841 (+ 498us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:23.692490 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:23.694026 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:23.695516 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:23.696265 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:23.696488 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:23.698174 (+ 1686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:23.698184 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:23.698202 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:34:23.698942 (+ 740us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:23.699040 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:34:23.699070 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:23.699240 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:23.699550 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 23:34:23.699937 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":412,"threads_started":1}
I20260808 23:34:23.705214 4914 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4: Neither blocks nor log segments found. Creating new log.
I20260808 23:34:23.706424 4914 log.cc:824] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4: Log is configured to *not* fsync() on all Append() calls
I20260808 23:34:23.709990 4914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4: No bootstrap required, opened a new log
I20260808 23:34:23.718189 4914 raft_consensus.cc:348] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79749d1970248859278d4b2b5a715a4" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38709 } }
I20260808 23:34:23.718824 4914 raft_consensus.cc:374] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:34:23.719004 4914 raft_consensus.cc:729] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c79749d1970248859278d4b2b5a715a4, State: Initialized, Role: FOLLOWER
I20260808 23:34:23.719864 4914 consensus_queue.cc:260] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79749d1970248859278d4b2b5a715a4" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38709 } }
I20260808 23:34:23.720211 4914 raft_consensus.cc:388] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:34:23.720386 4914 raft_consensus.cc:482] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:34:23.720628 4914 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:34:23.723044 4914 raft_consensus.cc:504] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79749d1970248859278d4b2b5a715a4" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38709 } }
I20260808 23:34:23.723650 4914 leader_election.cc:302] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c79749d1970248859278d4b2b5a715a4; no voters:
I20260808 23:34:23.724381 4914 leader_election.cc:288] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:34:23.724602 4919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:34:23.725406 4919 raft_consensus.cc:686] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [term 1 LEADER]: Becoming Leader. State: Replica: c79749d1970248859278d4b2b5a715a4, State: Running, Role: LEADER
I20260808 23:34:23.726017 4919 consensus_queue.cc:237] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79749d1970248859278d4b2b5a715a4" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38709 } }
I20260808 23:34:23.726725 4914 sys_catalog.cc:564] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:34:23.729316 4921 sys_catalog.cc:455] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c79749d1970248859278d4b2b5a715a4. Latest consensus state: current_term: 1 leader_uuid: "c79749d1970248859278d4b2b5a715a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79749d1970248859278d4b2b5a715a4" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38709 } } }
I20260808 23:34:23.729772 4921 sys_catalog.cc:458] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [sys.catalog]: This master's current role is: LEADER
I20260808 23:34:23.733035 4920 sys_catalog.cc:455] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c79749d1970248859278d4b2b5a715a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79749d1970248859278d4b2b5a715a4" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 38709 } } }
I20260808 23:34:23.733520 4920 sys_catalog.cc:458] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4 [sys.catalog]: This master's current role is: LEADER
I20260808 23:34:23.735080 4925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:34:23.740919 4925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:34:23.750770 4925 catalog_manager.cc:1347] Generated new cluster ID: 9f1e85995eac4c0fbdc532cee9158df7
I20260808 23:34:23.750913 4925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:34:23.787286 4925 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:34:23.789292 4925 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:34:23.808807 4925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c79749d1970248859278d4b2b5a715a4: Generated new TSK 0
I20260808 23:34:23.810052 4925 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:34:23.832839 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38709
--builtin_ntp_servers=127.26.207.212:39737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 23:34:24.207897 4940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:24.208305 4940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:24.208472 4940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:24.216161 4940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:24.216289 4940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:24.216460 4940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:34:24.226114 4940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:39737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38709
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:24.227638 4940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:24.229704 4940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:24.244390 4948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:24.244458 4945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:24.244908 4946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:24.245245 4940 server_base.cc:1034] running on GCE node
I20260808 23:34:24.245918 4940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:24.247001 4940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:24.248245 4940 hybrid_clock.cc:648] HybridClock initialized: now 1786232064248191 us; error 46 us; skew 500 ppm
I20260808 23:34:24.248606 4940 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:34:24.251248 4940 webserver.cc:460] Webserver started at http://127.26.207.193:37021/ using document root <none> and password file <none>
I20260808 23:34:24.252049 4940 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:24.252190 4940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:24.252558 4940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:34:24.255707 4940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "89063c67bacf46b2be045790c8e87372"
format_stamp: "Formatted at 2026-08-08 23:34:24 on dist-test-slave-1x4g"
server_key: "7e8264b8d1495a499e92b7b8f0941ee7"
server_key_iv: "83553996c7e5d04882663ba60299efa4"
server_key_version: "encryptionkey@0"
I20260808 23:34:24.256577 4940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "89063c67bacf46b2be045790c8e87372"
format_stamp: "Formatted at 2026-08-08 23:34:24 on dist-test-slave-1x4g"
server_key: "7e8264b8d1495a499e92b7b8f0941ee7"
server_key_iv: "83553996c7e5d04882663ba60299efa4"
server_key_version: "encryptionkey@0"
I20260808 23:34:24.262392 4940 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 23:34:24.266501 4954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:24.268133 4940 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:34:24.268467 4940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "89063c67bacf46b2be045790c8e87372"
format_stamp: "Formatted at 2026-08-08 23:34:24 on dist-test-slave-1x4g"
server_key: "7e8264b8d1495a499e92b7b8f0941ee7"
server_key_iv: "83553996c7e5d04882663ba60299efa4"
server_key_version: "encryptionkey@0"
I20260808 23:34:24.268739 4940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:24.281083 4940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:24.282081 4940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:24.282441 4940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:24.283583 4940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:34:24.285447 4940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:34:24.285585 4940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:24.285728 4940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:34:24.285825 4940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:24.322809 4940 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:37271
I20260808 23:34:24.322911 5071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:37271 every 8 connection(s)
I20260808 23:34:24.324287 4940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:34:24.325840 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 4940
I20260808 23:34:24.326092 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:34:24.327103 27455 external_mini_cluster.cc:1428] Setting key 54a84e92fb637063b4b89d92dabe34cd
I20260808 23:34:24.330487 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38709
--builtin_ntp_servers=127.26.207.212:39737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 23:34:24.339663 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:24.327546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:54727 (local address 127.26.207.254:38709)
0808 23:34:24.328145 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:24.328152 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:24.329685 (+ 1533us) server_negotiation.cc:407] Connection header received
0808 23:34:24.331824 (+ 2139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:24.331830 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:24.331951 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:24.332091 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:24.333461 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:24.334306 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:24.336201 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:24.336741 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:24.336933 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:24.338718 (+ 1785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:24.338724 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:24.338727 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:34:24.338750 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:24.338793 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:34:24.338806 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:24.338909 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:24.339161 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 23:34:24.339276 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":274,"threads_started":1}
I20260808 23:34:24.340987 5076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:24.328256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:38709 (local address 127.26.207.193:54727)
0808 23:34:24.329515 (+ 1259us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:24.329579 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:24.331504 (+ 1925us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:24.332378 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:24.332388 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:24.332500 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:24.333234 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:24.333257 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:24.334507 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:24.334512 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:24.336006 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:24.336024 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:24.337058 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:24.337067 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:24.337343 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:24.338306 (+ 963us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:34:24.338309 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:24.338364 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:34:24.338472 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:34:24.338909 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:34:24.338924 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:34:24.338935 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 23:34:24.339145 (+ 210us) client_negotiation.cc:240] Negotiation successful
0808 23:34:24.339610 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":352,"threads_started":1}
I20260808 23:34:24.342880 5073 heartbeater.cc:347] Connected to a master server at 127.26.207.254:38709
I20260808 23:34:24.343245 5073 heartbeater.cc:464] Registering TS with master...
I20260808 23:34:24.344091 5073 heartbeater.cc:511] Master 127.26.207.254:38709 requested a full tablet report, sending...
I20260808 23:34:24.346560 4875 ts_manager.cc:194] Registered new tserver with Master: 89063c67bacf46b2be045790c8e87372 (127.26.207.193:37271)
I20260808 23:34:24.348151 4875 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.207.193:54727
W20260808 23:34:24.700345 5077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:24.700738 5077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:24.700927 5077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:24.708966 5077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:24.709132 5077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:24.709307 5077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:34:24.719094 5077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:39737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38709
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:24.720584 5077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:24.722579 5077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:24.737398 5085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:24.737373 5084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:24.737670 5087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:24.738467 5077 server_base.cc:1034] running on GCE node
I20260808 23:34:24.739209 5077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:24.740290 5077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:24.741541 5077 hybrid_clock.cc:648] HybridClock initialized: now 1786232064741505 us; error 43 us; skew 500 ppm
I20260808 23:34:24.741928 5077 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:34:24.744683 5077 webserver.cc:460] Webserver started at http://127.26.207.194:46313/ using document root <none> and password file <none>
I20260808 23:34:24.745563 5077 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:24.745707 5077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:24.746073 5077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:34:24.749390 5077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "2794cc7f0de74a239cb4577e6be41b20"
format_stamp: "Formatted at 2026-08-08 23:34:24 on dist-test-slave-1x4g"
server_key: "fc48ca5bb5b373bc654801e70b965157"
server_key_iv: "0e7f7c916838001693fc001864be1eef"
server_key_version: "encryptionkey@0"
I20260808 23:34:24.750320 5077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "2794cc7f0de74a239cb4577e6be41b20"
format_stamp: "Formatted at 2026-08-08 23:34:24 on dist-test-slave-1x4g"
server_key: "fc48ca5bb5b373bc654801e70b965157"
server_key_iv: "0e7f7c916838001693fc001864be1eef"
server_key_version: "encryptionkey@0"
I20260808 23:34:24.756382 5077 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 23:34:24.760566 5093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:24.762244 5077 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:34:24.762454 5077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "2794cc7f0de74a239cb4577e6be41b20"
format_stamp: "Formatted at 2026-08-08 23:34:24 on dist-test-slave-1x4g"
server_key: "fc48ca5bb5b373bc654801e70b965157"
server_key_iv: "0e7f7c916838001693fc001864be1eef"
server_key_version: "encryptionkey@0"
I20260808 23:34:24.762701 5077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:24.777848 5077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:24.778788 5077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:24.779109 5077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:24.780144 5077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:34:24.781822 5077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:34:24.781940 5077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:24.782081 5077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:34:24.782164 5077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:24.817723 5077 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:33207
I20260808 23:34:24.817773 5211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:33207 every 8 connection(s)
I20260808 23:34:24.819199 5077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:34:24.825350 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 5077
I20260808 23:34:24.825533 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:34:24.826136 27455 external_mini_cluster.cc:1428] Setting key d662e0719f9959964f622bcd21bc7b7d
I20260808 23:34:24.831161 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38709
--builtin_ntp_servers=127.26.207.212:39737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 23:34:24.837150 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:24.822115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:39995 (local address 127.26.207.254:38709)
0808 23:34:24.822304 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:24.822309 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:24.823878 (+ 1569us) server_negotiation.cc:407] Connection header received
0808 23:34:24.826268 (+ 2390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:24.826278 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:24.826384 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:24.826492 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:24.828281 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:24.829611 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:24.832570 (+ 2959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:24.833248 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:24.833411 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:24.835788 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:24.835795 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:24.835800 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:34:24.835830 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:24.835875 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:34:24.835897 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:24.835999 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:24.836618 (+ 619us) server_negotiation.cc:299] Negotiation successful
0808 23:34:24.836753 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 23:34:24.838829 5214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:24.822693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:38709 (local address 127.26.207.194:39995)
0808 23:34:24.823699 (+ 1006us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:24.823738 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:24.825899 (+ 2161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:24.826895 (+ 996us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:24.826912 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:24.827055 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:24.828072 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:24.828106 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:24.829834 (+ 1728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:24.829840 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:24.832301 (+ 2461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:24.832324 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:24.833802 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:24.833812 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:24.834247 (+ 435us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:24.835262 (+ 1015us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:34:24.835266 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:24.835346 (+ 80us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:34:24.835477 (+ 131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:34:24.836249 (+ 772us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:34:24.836265 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:34:24.836278 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 23:34:24.836563 (+ 285us) client_negotiation.cc:240] Negotiation successful
0808 23:34:24.837181 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":321,"threads_started":1}
I20260808 23:34:24.840582 5212 heartbeater.cc:347] Connected to a master server at 127.26.207.254:38709
I20260808 23:34:24.841001 5212 heartbeater.cc:464] Registering TS with master...
I20260808 23:34:24.842139 5212 heartbeater.cc:511] Master 127.26.207.254:38709 requested a full tablet report, sending...
I20260808 23:34:24.844033 4875 ts_manager.cc:194] Registered new tserver with Master: 2794cc7f0de74a239cb4577e6be41b20 (127.26.207.194:33207)
I20260808 23:34:24.845008 4875 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.207.194:39995
W20260808 23:34:25.198238 5215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:25.198567 5215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:25.198661 5215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:25.206233 5215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:25.206357 5215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:25.206467 5215 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:34:25.216154 5215 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:39737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:38709
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:25.217573 5215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:25.219448 5215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:25.233796 5221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:25.233767 5222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:25.233986 5224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:25.235273 5215 server_base.cc:1034] running on GCE node
I20260808 23:34:25.236120 5215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:25.237305 5215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:25.238539 5215 hybrid_clock.cc:648] HybridClock initialized: now 1786232065238463 us; error 66 us; skew 500 ppm
I20260808 23:34:25.238920 5215 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:34:25.241655 5215 webserver.cc:460] Webserver started at http://127.26.207.195:46233/ using document root <none> and password file <none>
I20260808 23:34:25.242499 5215 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:25.242640 5215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:25.243011 5215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:34:25.246337 5215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "06c0d0927e99416c972dc8434a94f521"
format_stamp: "Formatted at 2026-08-08 23:34:25 on dist-test-slave-1x4g"
server_key: "abc92e984d61c792c8a88ee13d648be1"
server_key_iv: "731303ff95173ebfaa97aae64f4fe2ed"
server_key_version: "encryptionkey@0"
I20260808 23:34:25.247277 5215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "06c0d0927e99416c972dc8434a94f521"
format_stamp: "Formatted at 2026-08-08 23:34:25 on dist-test-slave-1x4g"
server_key: "abc92e984d61c792c8a88ee13d648be1"
server_key_iv: "731303ff95173ebfaa97aae64f4fe2ed"
server_key_version: "encryptionkey@0"
I20260808 23:34:25.253254 5215 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 23:34:25.257264 5230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:25.258800 5215 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 23:34:25.259011 5215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "06c0d0927e99416c972dc8434a94f521"
format_stamp: "Formatted at 2026-08-08 23:34:25 on dist-test-slave-1x4g"
server_key: "abc92e984d61c792c8a88ee13d648be1"
server_key_iv: "731303ff95173ebfaa97aae64f4fe2ed"
server_key_version: "encryptionkey@0"
I20260808 23:34:25.259265 5215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:25.278869 5215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:25.279889 5215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:25.280242 5215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:25.281396 5215 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:34:25.283147 5215 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:34:25.283293 5215 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:25.283432 5215 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:34:25.283522 5215 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:25.320360 5215 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:45557
I20260808 23:34:25.320415 5350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:45557 every 8 connection(s)
I20260808 23:34:25.322003 5215 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:34:25.326555 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 5215
I20260808 23:34:25.326753 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:34:25.327363 27455 external_mini_cluster.cc:1428] Setting key 81e304b2674bedb8e282a4cb174ea1cb
I20260808 23:34:25.337069 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:25.325110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:47405 (local address 127.26.207.254:38709)
0808 23:34:25.325355 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:25.325362 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:25.327649 (+ 2287us) server_negotiation.cc:407] Connection header received
0808 23:34:25.330250 (+ 2601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:25.330256 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:25.330347 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:25.330458 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:25.331770 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:25.332549 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:25.334273 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:25.334682 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:25.334782 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:25.336298 (+ 1516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:25.336303 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:25.336306 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:34:25.336326 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:25.336358 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:34:25.336370 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:25.336440 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:25.336671 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 23:34:25.336754 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 23:34:25.338145 5353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:25.325789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:38709 (local address 127.26.207.195:47405)
0808 23:34:25.327415 (+ 1626us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:25.327482 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:25.329965 (+ 2483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:25.330778 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:25.330793 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:25.330967 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:25.331599 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:25.331617 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:25.332697 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:25.332701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:25.334115 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:25.334133 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:25.334910 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:25.334916 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:25.335159 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:25.335904 (+ 745us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:34:25.335907 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:25.335949 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:34:25.336093 (+ 144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:34:25.336458 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:34:25.336466 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:34:25.336472 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 23:34:25.336634 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 23:34:25.337032 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":763,"thread_start_us":491,"threads_started":1}
I20260808 23:34:25.339744 5351 heartbeater.cc:347] Connected to a master server at 127.26.207.254:38709
I20260808 23:34:25.340113 5351 heartbeater.cc:464] Registering TS with master...
I20260808 23:34:25.341101 5351 heartbeater.cc:511] Master 127.26.207.254:38709 requested a full tablet report, sending...
I20260808 23:34:25.343010 4875 ts_manager.cc:194] Registered new tserver with Master: 06c0d0927e99416c972dc8434a94f521 (127.26.207.195:45557)
I20260808 23:34:25.344175 4875 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.207.195:47405
I20260808 23:34:25.344295 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 23:34:25.351631 5075 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:25.349983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39554 (local address 127.26.207.254:38709)
0808 23:34:25.350157 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:25.350161 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:25.350665 (+ 504us) server_negotiation.cc:407] Connection header received
0808 23:34:25.350813 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:25.350817 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:25.350885 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:25.350972 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:25.351388 (+ 416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39554: BlockingRecv error: recv got EOF from 127.0.0.1:39554 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 23:34:25.351627 5073 heartbeater.cc:503] Master 127.26.207.254:38709 was elected leader, sending a full tablet report...
I20260808 23:34:25.352936 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 4940
I20260808 23:34:25.361560 5361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:25.353959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47676 (local address 127.26.207.193:37271)
0808 23:34:25.354500 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:25.354507 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:25.354537 (+ 30us) server_negotiation.cc:407] Connection header received
0808 23:34:25.354602 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:25.354608 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:25.354827 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:25.354965 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:25.355376 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:25.356447 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:25.357878 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:25.358517 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:25.358626 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:25.359885 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:25.359925 (+ 40us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:25.359941 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:34:25.360568 (+ 627us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:25.360628 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:34:25.360652 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:25.360758 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:25.361009 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 23:34:25.361144 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":267,"threads_started":1}
I20260808 23:34:25.362988 5067 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:25.451717 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 4940
I20260808 23:34:25.473744 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 5077
I20260808 23:34:25.482473 5363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:25.474679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54062 (local address 127.26.207.194:33207)
0808 23:34:25.475243 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:25.475250 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:25.475279 (+ 29us) server_negotiation.cc:407] Connection header received
0808 23:34:25.475351 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:25.475358 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:25.475600 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:25.475790 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:25.476233 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:25.477374 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:25.478741 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:25.479349 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:25.479511 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:25.480734 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:25.480744 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:25.480759 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:34:25.481524 (+ 765us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:25.481581 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:34:25.481609 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:25.481743 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:25.481910 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 23:34:25.482090 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":287,"threads_started":1}
I20260808 23:34:25.483856 5207 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:25.570317 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 5077
I20260808 23:34:25.590857 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 5215
I20260808 23:34:25.600183 5366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:25.592050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33092 (local address 127.26.207.195:45557)
0808 23:34:25.592697 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:25.592705 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:25.592737 (+ 32us) server_negotiation.cc:407] Connection header received
0808 23:34:25.592863 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:25.592871 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:25.593215 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:25.593357 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:25.593832 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:25.594946 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:25.596294 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:25.597106 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:25.597211 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:25.598343 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:25.598353 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:25.598367 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:34:25.599019 (+ 652us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:25.599074 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:34:25.599096 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:25.599255 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:25.599453 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 23:34:25.599624 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":324,"threads_started":1}
I20260808 23:34:25.602099 5346 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:25.694029 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 5215
I20260808 23:34:25.716920 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 4841
I20260808 23:34:25.718359 4908 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:25.827908 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 4841
2026-08-08T23:34:25Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2723 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T23:34:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:34:25Z Disabled control of system clock
I20260808 23:34:25.924693 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:37305
--webserver_interface=127.26.207.254
--webserver_port=0
--builtin_ntp_servers=127.26.207.212:37161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:37305
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 23:34:26.289628 5372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:26.289986 5372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:26.290074 5372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:26.297961 5372 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:34:26.298098 5372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:26.298137 5372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:26.298190 5372 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:34:26.298237 5372 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:34:26.308221 5372 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:37161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:37305
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:37305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:26.309711 5372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:26.311589 5372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:26.324996 5377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:26.325047 5378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:26.325083 5380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:26.325783 5372 server_base.cc:1034] running on GCE node
I20260808 23:34:26.326768 5372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:26.328454 5372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:26.329725 5372 hybrid_clock.cc:648] HybridClock initialized: now 1786232066329646 us; error 61 us; skew 500 ppm
I20260808 23:34:26.330165 5372 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:34:26.332955 5372 webserver.cc:460] Webserver started at http://127.26.207.254:36011/ using document root <none> and password file <none>
I20260808 23:34:26.333813 5372 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:26.333916 5372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:26.334314 5372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:34:26.337728 5372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "03057f7277f240b8a427a65e193fe864"
format_stamp: "Formatted at 2026-08-08 23:34:26 on dist-test-slave-1x4g"
server_key: "466b0b1153189d2baa8295961e9b0ca1"
server_key_iv: "613b84e6e5fc11c40f552e302c28e6c7"
server_key_version: "encryptionkey@0"
I20260808 23:34:26.338680 5372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "03057f7277f240b8a427a65e193fe864"
format_stamp: "Formatted at 2026-08-08 23:34:26 on dist-test-slave-1x4g"
server_key: "466b0b1153189d2baa8295961e9b0ca1"
server_key_iv: "613b84e6e5fc11c40f552e302c28e6c7"
server_key_version: "encryptionkey@0"
I20260808 23:34:26.344861 5372 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.006s
I20260808 23:34:26.348918 5386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:26.350582 5372 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 23:34:26.350816 5372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "03057f7277f240b8a427a65e193fe864"
format_stamp: "Formatted at 2026-08-08 23:34:26 on dist-test-slave-1x4g"
server_key: "466b0b1153189d2baa8295961e9b0ca1"
server_key_iv: "613b84e6e5fc11c40f552e302c28e6c7"
server_key_version: "encryptionkey@0"
I20260808 23:34:26.351082 5372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:26.357815 5372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:26.358796 5372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:26.359158 5372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:26.379657 5372 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:37305
I20260808 23:34:26.379695 5440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:37305 every 8 connection(s)
I20260808 23:34:26.381212 5372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:34:26.385671 5441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:34:26.387946 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 5372
I20260808 23:34:26.388190 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:34:26.388902 27455 external_mini_cluster.cc:1428] Setting key 6c41213b7932b70180a8bfbc34b1268b
I20260808 23:34:26.398736 5444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:26.391379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58880 (local address 127.26.207.254:37305)
0808 23:34:26.392534 (+ 1155us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:26.392547 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:26.392593 (+ 46us) server_negotiation.cc:407] Connection header received
0808 23:34:26.394493 (+ 1900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:26.394527 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:26.395037 (+ 510us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:26.395564 (+ 527us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:26.396912 (+ 1348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:26.396919 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:26.396934 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:34:26.396950 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:26.397025 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:34:26.397044 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:26.397250 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:26.397380 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 23:34:26.397731 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":685,"thread_start_us":413,"threads_started":1}
I20260808 23:34:26.399611 5441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864: Bootstrap starting.
I20260808 23:34:26.403859 5441 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864: Neither blocks nor log segments found. Creating new log.
I20260808 23:34:26.405171 5441 log.cc:824] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864: Log is configured to *not* fsync() on all Append() calls
I20260808 23:34:26.408315 5441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864: No bootstrap required, opened a new log
I20260808 23:34:26.416014 5441 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03057f7277f240b8a427a65e193fe864" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37305 } }
I20260808 23:34:26.416486 5441 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:34:26.416633 5441 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03057f7277f240b8a427a65e193fe864, State: Initialized, Role: FOLLOWER
I20260808 23:34:26.417395 5441 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03057f7277f240b8a427a65e193fe864" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37305 } }
I20260808 23:34:26.417639 5441 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:34:26.417775 5441 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:34:26.417915 5441 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:34:26.420234 5441 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03057f7277f240b8a427a65e193fe864" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37305 } }
I20260808 23:34:26.420817 5441 leader_election.cc:302] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03057f7277f240b8a427a65e193fe864; no voters:
I20260808 23:34:26.421528 5441 leader_election.cc:288] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:34:26.421754 5446 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:34:26.422566 5446 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [term 1 LEADER]: Becoming Leader. State: Replica: 03057f7277f240b8a427a65e193fe864, State: Running, Role: LEADER
I20260808 23:34:26.423177 5446 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03057f7277f240b8a427a65e193fe864" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37305 } }
I20260808 23:34:26.423878 5441 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:34:26.426141 5448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03057f7277f240b8a427a65e193fe864. Latest consensus state: current_term: 1 leader_uuid: "03057f7277f240b8a427a65e193fe864" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03057f7277f240b8a427a65e193fe864" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37305 } } }
I20260808 23:34:26.426576 5448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [sys.catalog]: This master's current role is: LEADER
I20260808 23:34:26.429461 5454 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:34:26.429276 5447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03057f7277f240b8a427a65e193fe864" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03057f7277f240b8a427a65e193fe864" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37305 } } }
I20260808 23:34:26.429704 5447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864 [sys.catalog]: This master's current role is: LEADER
I20260808 23:34:26.435461 5454 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:34:26.446319 5454 catalog_manager.cc:1347] Generated new cluster ID: 89a03b25324649e89047faebdae247d4
I20260808 23:34:26.446480 5454 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:34:26.489560 5454 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:34:26.490092 5454 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:34:26.497365 5454 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03057f7277f240b8a427a65e193fe864: Generated new TSK 0
I20260808 23:34:26.498656 5454 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:34:26.517459 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:37305
--builtin_ntp_servers=127.26.207.212:37161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 23:34:26.894075 5466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:26.894441 5466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:26.894543 5466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:26.902506 5466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:26.902626 5466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:26.902742 5466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:34:26.912729 5466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:37161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:37305
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:26.914245 5466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:26.916141 5466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:26.930492 5472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:26.930521 5471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:26.930786 5474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:26.931769 5466 server_base.cc:1034] running on GCE node
I20260808 23:34:26.932526 5466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:26.933775 5466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:26.935038 5466 hybrid_clock.cc:648] HybridClock initialized: now 1786232066934987 us; error 48 us; skew 500 ppm
I20260808 23:34:26.935439 5466 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:34:26.943502 5466 webserver.cc:460] Webserver started at http://127.26.207.193:36527/ using document root <none> and password file <none>
I20260808 23:34:26.944387 5466 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:26.944541 5466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:26.944983 5466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:34:26.948218 5466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "98c534dc51a74801946cb1ddc70a5500"
format_stamp: "Formatted at 2026-08-08 23:34:26 on dist-test-slave-1x4g"
server_key: "d56cfb4b4c5d0f4b44ce96d4d6371493"
server_key_iv: "8f46ccbd31f21e6686edc3cc4ebfb221"
server_key_version: "encryptionkey@0"
I20260808 23:34:26.949255 5466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "98c534dc51a74801946cb1ddc70a5500"
format_stamp: "Formatted at 2026-08-08 23:34:26 on dist-test-slave-1x4g"
server_key: "d56cfb4b4c5d0f4b44ce96d4d6371493"
server_key_iv: "8f46ccbd31f21e6686edc3cc4ebfb221"
server_key_version: "encryptionkey@0"
I20260808 23:34:26.955374 5466 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.001s
I20260808 23:34:26.959540 5480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:26.961167 5466 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 23:34:26.961362 5466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "98c534dc51a74801946cb1ddc70a5500"
format_stamp: "Formatted at 2026-08-08 23:34:26 on dist-test-slave-1x4g"
server_key: "d56cfb4b4c5d0f4b44ce96d4d6371493"
server_key_iv: "8f46ccbd31f21e6686edc3cc4ebfb221"
server_key_version: "encryptionkey@0"
I20260808 23:34:26.961623 5466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:26.968006 5466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:26.969002 5466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:26.969312 5466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:26.970343 5466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:34:26.972075 5466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:34:26.972213 5466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:26.972357 5466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:34:26.972447 5466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:27.009122 5466 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:34803
I20260808 23:34:27.009387 5603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:34803 every 8 connection(s)
I20260808 23:34:27.010617 5466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:34:27.019629 5606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:27.013491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:43045 (local address 127.26.207.254:37305)
0808 23:34:27.013966 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:27.013971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:27.015473 (+ 1502us) server_negotiation.cc:407] Connection header received
0808 23:34:27.017370 (+ 1897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:27.017375 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:27.017440 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:27.017562 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:27.018935 (+ 1373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:27.018940 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:27.018944 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:34:27.018963 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:27.019016 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:34:27.019031 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:27.019147 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:27.019316 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 23:34:27.019378 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":238,"threads_started":1}
I20260808 23:34:27.020641 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 5466
I20260808 23:34:27.020701 5607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:27.014168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:37305 (local address 127.26.207.193:43045)
0808 23:34:27.015228 (+ 1060us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:27.015268 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:27.017055 (+ 1787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:27.017787 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:27.017796 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:27.017900 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:27.018599 (+ 699us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:34:27.018602 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:27.018645 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:34:27.018746 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:34:27.019122 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:34:27.019130 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:34:27.019136 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 23:34:27.019378 (+ 242us) client_negotiation.cc:240] Negotiation successful
0808 23:34:27.019627 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":328,"threads_started":1}
I20260808 23:34:27.020905 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:34:27.021684 27455 external_mini_cluster.cc:1428] Setting key ff46d161667725616ee4bcfefc1d3eb9
I20260808 23:34:27.022713 5604 heartbeater.cc:347] Connected to a master server at 127.26.207.254:37305
I20260808 23:34:27.023051 5604 heartbeater.cc:464] Registering TS with master...
I20260808 23:34:27.023751 5604 heartbeater.cc:511] Master 127.26.207.254:37305 requested a full tablet report, sending...
I20260808 23:34:27.025210 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:37305
--builtin_ntp_servers=127.26.207.212:37161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 23:34:27.026377 5403 ts_manager.cc:194] Registered new tserver with Master: 98c534dc51a74801946cb1ddc70a5500 (127.26.207.193:34803)
W20260808 23:34:27.391706 5608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:27.392107 5608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:27.392274 5608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:27.400565 5608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:27.400753 5608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:27.400995 5608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:34:27.412456 5608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:37161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:37305
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:27.414060 5608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:27.416244 5608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:27.430847 5617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:27.430965 5615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:27.430943 5614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:27.431922 5608 server_base.cc:1034] running on GCE node
I20260808 23:34:27.432654 5608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:27.433741 5608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:27.435026 5608 hybrid_clock.cc:648] HybridClock initialized: now 1786232067434970 us; error 53 us; skew 500 ppm
I20260808 23:34:27.435382 5608 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:34:27.438109 5608 webserver.cc:460] Webserver started at http://127.26.207.194:35847/ using document root <none> and password file <none>
I20260808 23:34:27.438912 5608 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:27.439050 5608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:27.439401 5608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:34:27.442886 5608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "4280e3d990294286a761a59fad5f3a2b"
format_stamp: "Formatted at 2026-08-08 23:34:27 on dist-test-slave-1x4g"
server_key: "3543810e1dad6a053eb44b32572e470f"
server_key_iv: "f52d2dea0ebc495284e7fe2367f66e49"
server_key_version: "encryptionkey@0"
I20260808 23:34:27.443948 5608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "4280e3d990294286a761a59fad5f3a2b"
format_stamp: "Formatted at 2026-08-08 23:34:27 on dist-test-slave-1x4g"
server_key: "3543810e1dad6a053eb44b32572e470f"
server_key_iv: "f52d2dea0ebc495284e7fe2367f66e49"
server_key_version: "encryptionkey@0"
I20260808 23:34:27.450286 5608 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 23:34:27.454380 5624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:27.456046 5608 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:34:27.456252 5608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "4280e3d990294286a761a59fad5f3a2b"
format_stamp: "Formatted at 2026-08-08 23:34:27 on dist-test-slave-1x4g"
server_key: "3543810e1dad6a053eb44b32572e470f"
server_key_iv: "f52d2dea0ebc495284e7fe2367f66e49"
server_key_version: "encryptionkey@0"
I20260808 23:34:27.456521 5608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:27.462785 5608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:27.463794 5608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:27.464166 5608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:27.465327 5608 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:34:27.467211 5608 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:34:27.467334 5608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:27.467478 5608 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:34:27.467590 5608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:27.502365 5608 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:46139
I20260808 23:34:27.502422 5746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:46139 every 8 connection(s)
I20260808 23:34:27.504009 5608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:34:27.508214 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 5608
I20260808 23:34:27.508424 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:34:27.509027 27455 external_mini_cluster.cc:1428] Setting key 1f69ab243787402f149e61187d046d25
I20260808 23:34:27.512660 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:37305
--builtin_ntp_servers=127.26.207.212:37161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 23:34:27.513986 5606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:27.507067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:34475 (local address 127.26.207.254:37305)
0808 23:34:27.507259 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:27.507264 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:27.508909 (+ 1645us) server_negotiation.cc:407] Connection header received
0808 23:34:27.511240 (+ 2331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:27.511244 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:27.511352 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:27.511461 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:27.513138 (+ 1677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:27.513147 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:27.513154 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:34:27.513180 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:27.513227 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:34:27.513246 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:27.513392 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:27.513546 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 23:34:27.513620 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 23:34:27.514904 5749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:27.507481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:37305 (local address 127.26.207.194:34475)
0808 23:34:27.508686 (+ 1205us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:27.508728 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:27.510884 (+ 2156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:27.511699 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:27.511708 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:27.511812 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:27.512682 (+ 870us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:34:27.512685 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:27.512728 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:34:27.512917 (+ 189us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:34:27.513347 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:34:27.513355 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:34:27.513361 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 23:34:27.513594 (+ 233us) client_negotiation.cc:240] Negotiation successful
0808 23:34:27.513825 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":400,"threads_started":1}
I20260808 23:34:27.516532 5747 heartbeater.cc:347] Connected to a master server at 127.26.207.254:37305
I20260808 23:34:27.516932 5747 heartbeater.cc:464] Registering TS with master...
I20260808 23:34:27.517597 5747 heartbeater.cc:511] Master 127.26.207.254:37305 requested a full tablet report, sending...
I20260808 23:34:27.519115 5403 ts_manager.cc:194] Registered new tserver with Master: 4280e3d990294286a761a59fad5f3a2b (127.26.207.194:46139)
W20260808 23:34:27.889910 5751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:27.890244 5751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:27.890336 5751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:27.897897 5751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:27.898032 5751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:27.898152 5751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:34:27.907719 5751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:37161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:37305
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:27.909170 5751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:27.911022 5751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:27.925377 5757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:27.925364 5761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:27.925647 5758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:27.926455 5751 server_base.cc:1034] running on GCE node
I20260808 23:34:27.927171 5751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:27.928247 5751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:27.929482 5751 hybrid_clock.cc:648] HybridClock initialized: now 1786232067929415 us; error 63 us; skew 500 ppm
I20260808 23:34:27.929886 5751 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:34:27.932375 5751 webserver.cc:460] Webserver started at http://127.26.207.195:44699/ using document root <none> and password file <none>
I20260808 23:34:27.933238 5751 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:27.933378 5751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:27.933732 5751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:34:27.940062 5751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "58aa22b0f35b4cf093ccbf09aba9d969"
format_stamp: "Formatted at 2026-08-08 23:34:27 on dist-test-slave-1x4g"
server_key: "b2b4b956415d7792a741333e044ceb07"
server_key_iv: "cc2f343b1a3abf10dba87f0153e866bf"
server_key_version: "encryptionkey@0"
I20260808 23:34:27.941229 5751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "58aa22b0f35b4cf093ccbf09aba9d969"
format_stamp: "Formatted at 2026-08-08 23:34:27 on dist-test-slave-1x4g"
server_key: "b2b4b956415d7792a741333e044ceb07"
server_key_iv: "cc2f343b1a3abf10dba87f0153e866bf"
server_key_version: "encryptionkey@0"
I20260808 23:34:27.947301 5751 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.005s
I20260808 23:34:27.951151 5767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:27.952606 5751 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 23:34:27.952844 5751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "58aa22b0f35b4cf093ccbf09aba9d969"
format_stamp: "Formatted at 2026-08-08 23:34:27 on dist-test-slave-1x4g"
server_key: "b2b4b956415d7792a741333e044ceb07"
server_key_iv: "cc2f343b1a3abf10dba87f0153e866bf"
server_key_version: "encryptionkey@0"
I20260808 23:34:27.953100 5751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:27.959385 5751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:27.960300 5751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:27.960637 5751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:27.961971 5751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:34:27.963553 5751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:34:27.963693 5751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:27.963825 5751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:34:27.963914 5751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:27.999660 5751 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:44227
I20260808 23:34:27.999753 5891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:44227 every 8 connection(s)
I20260808 23:34:28.001116 5751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:34:28.008859 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 5751
I20260808 23:34:28.009093 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:34:28.009713 27455 external_mini_cluster.cc:1428] Setting key 989e937c6b775db88d6b19142e66c12d
I20260808 23:34:28.010339 5606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:28.003939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:55791 (local address 127.26.207.254:37305)
0808 23:34:28.004192 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:28.004197 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:28.005728 (+ 1531us) server_negotiation.cc:407] Connection header received
0808 23:34:28.007511 (+ 1783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:28.007516 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:28.007580 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:28.007682 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:28.009433 (+ 1751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:28.009440 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:28.009445 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:34:28.009473 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:28.009512 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:34:28.009531 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:28.009676 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:28.009953 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 23:34:28.010041 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260808 23:34:28.011693 5894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:28.004489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:37305 (local address 127.26.207.195:55791)
0808 23:34:28.005548 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:28.005594 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:28.007190 (+ 1596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:28.007911 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:28.007919 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:28.008063 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:28.008946 (+ 883us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:34:28.008949 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:28.009048 (+ 99us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:34:28.009203 (+ 155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:34:28.009642 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:34:28.009655 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:34:28.009664 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 23:34:28.010059 (+ 395us) client_negotiation.cc:240] Negotiation successful
0808 23:34:28.010364 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":335,"threads_started":1}
I20260808 23:34:28.013545 5892 heartbeater.cc:347] Connected to a master server at 127.26.207.254:37305
I20260808 23:34:28.013921 5892 heartbeater.cc:464] Registering TS with master...
I20260808 23:34:28.014670 5892 heartbeater.cc:511] Master 127.26.207.254:37305 requested a full tablet report, sending...
I20260808 23:34:28.016433 5403 ts_manager.cc:194] Registered new tserver with Master: 58aa22b0f35b4cf093ccbf09aba9d969 (127.26.207.195:44227)
I20260808 23:34:28.026461 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:34:28.030109 5604 heartbeater.cc:503] Master 127.26.207.254:37305 was elected leader, sending a full tablet report...
W20260808 23:34:28.033936 5606 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:34:28.031932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58890 (local address 127.26.207.254:37305)
0808 23:34:28.032281 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:28.032288 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:28.032947 (+ 659us) server_negotiation.cc:407] Connection header received
0808 23:34:28.033163 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:28.033168 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:28.033225 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:28.033330 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:28.033706 (+ 376us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58890: BlockingRecv error: recv got EOF from 127.0.0.1:58890 (error 108)
Metrics: {"server-negotiator.queue_time_us":157}
I20260808 23:34:28.034814 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 5466
I20260808 23:34:28.038446 5902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:28.035760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42318 (local address 127.26.207.193:34803)
0808 23:34:28.036326 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:28.036333 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:28.036361 (+ 28us) server_negotiation.cc:407] Connection header received
0808 23:34:28.036422 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:28.036428 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:28.036664 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:28.036855 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:28.037812 (+ 957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:28.037819 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:28.037830 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:34:28.037842 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:28.037882 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:34:28.037897 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:28.038048 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:28.038097 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 23:34:28.038179 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":253,"threads_started":1}
I20260808 23:34:28.039762 5598 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:28.125331 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 5466
I20260808 23:34:28.146726 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 5608
I20260808 23:34:28.150501 5904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:28.147758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42168 (local address 127.26.207.194:46139)
0808 23:34:28.148306 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:28.148314 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:28.148342 (+ 28us) server_negotiation.cc:407] Connection header received
0808 23:34:28.148411 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:28.148417 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:28.148666 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:28.148863 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:28.149842 (+ 979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:28.149849 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:28.149862 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:34:28.149879 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:28.149921 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:34:28.149935 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:28.150053 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:28.150143 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 23:34:28.150231 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":277,"threads_started":1}
I20260808 23:34:28.151859 5742 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:28.237644 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 5608
I20260808 23:34:28.259012 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 5751
I20260808 23:34:28.263650 5906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:28.260175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34962 (local address 127.26.207.195:44227)
0808 23:34:28.260935 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:28.260942 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:28.260974 (+ 32us) server_negotiation.cc:407] Connection header received
0808 23:34:28.261041 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:28.261048 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:28.261284 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:28.261477 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:28.262795 (+ 1318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:28.262803 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:28.262815 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:34:28.262827 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:28.262879 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:34:28.262894 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:28.263116 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:28.263198 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 23:34:28.263314 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":369,"threads_started":1}
I20260808 23:34:28.265208 5887 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:28.351347 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 5751
I20260808 23:34:28.372357 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 5372
I20260808 23:34:28.373812 5436 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:28.482373 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 5372
2026-08-08T23:34:28Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2654 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:34:28 dist-test-slave-1x4g krb5kdc[5911](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:34:28 dist-test-slave-1x4g krb5kdc[5911](info): set up 2 sockets
Aug 08 23:34:28 dist-test-slave-1x4g krb5kdc[5911](info): commencing operation
krb5kdc: starting...
W20260808 23:34:29.670324 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:34:29 dist-test-slave-1x4g krb5kdc[5911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:34:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:34:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:34:29.998013 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:37603
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:40851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:37603
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:34:30.367166 5926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:30.367570 5926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:30.367727 5926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:30.375631 5926 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:34:30.375823 5926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:30.375924 5926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:30.376025 5926 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:34:30.376106 5926 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:34:30.386956 5926 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:40851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:37603
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:37603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:30.388507 5926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:30.390071 5926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:30.403312 5933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:30.403417 5932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:30.403702 5935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:30.404808 5926 server_base.cc:1034] running on GCE node
I20260808 23:34:30.405754 5926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:30.407433 5926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:30.408659 5926 hybrid_clock.cc:648] HybridClock initialized: now 1786232070408605 us; error 44 us; skew 500 ppm
I20260808 23:34:30.409098 5926 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:34:30 dist-test-slave-1x4g krb5kdc[5911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232070, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:34:30.412631 5926 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:34:30.414455 5926 webserver.cc:460] Webserver started at http://127.26.207.254:44645/ using document root <none> and password file <none>
I20260808 23:34:30.415302 5926 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:30.415503 5926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:30.415926 5926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:34:30.420400 5926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "6d1a0ae7b8724e0191aca8be8d870e5c"
format_stamp: "Formatted at 2026-08-08 23:34:30 on dist-test-slave-1x4g"
server_key: "396c3312bbe96d4c1063103d0515c21d"
server_key_iv: "4351a1b14aaef3b4874a252c85f99dbd"
server_key_version: "encryptionkey@0"
I20260808 23:34:30.421404 5926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "6d1a0ae7b8724e0191aca8be8d870e5c"
format_stamp: "Formatted at 2026-08-08 23:34:30 on dist-test-slave-1x4g"
server_key: "396c3312bbe96d4c1063103d0515c21d"
server_key_iv: "4351a1b14aaef3b4874a252c85f99dbd"
server_key_version: "encryptionkey@0"
I20260808 23:34:30.427920 5926 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 23:34:30.432294 5944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:30.433995 5926 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:34:30.434237 5926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "6d1a0ae7b8724e0191aca8be8d870e5c"
format_stamp: "Formatted at 2026-08-08 23:34:30 on dist-test-slave-1x4g"
server_key: "396c3312bbe96d4c1063103d0515c21d"
server_key_iv: "4351a1b14aaef3b4874a252c85f99dbd"
server_key_version: "encryptionkey@0"
I20260808 23:34:30.434469 5926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:30.469190 5926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:30.474145 5926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:30.474481 5926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:30.494779 5926 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:37603
I20260808 23:34:30.494817 6000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:37603 every 8 connection(s)
I20260808 23:34:30.496390 5926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:34:30.500558 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:34:30.502110 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 5926
I20260808 23:34:30.502364 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:34:30.503046 27455 external_mini_cluster.cc:1428] Setting key 1346193891c347663a493a172f3fe837
I20260808 23:34:30.516289 6001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c: Bootstrap starting.
Aug 08 23:34:30 dist-test-slave-1x4g krb5kdc[5911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:34:30.520653 6001 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c: Neither blocks nor log segments found. Creating new log.
I20260808 23:34:30.522236 6001 log.cc:824] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c: Log is configured to *not* fsync() on all Append() calls
I20260808 23:34:30.526295 6001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c: No bootstrap required, opened a new log
I20260808 23:34:30.530874 6005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:30.505301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36090 (local address 127.26.207.254:37603)
0808 23:34:30.506237 (+ 936us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:30.506258 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:30.506313 (+ 55us) server_negotiation.cc:407] Connection header received
0808 23:34:30.508121 (+ 1808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:30.508157 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:30.508809 (+ 652us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:30.509307 (+ 498us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:30.510809 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:30.513004 (+ 2195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:30.514436 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:30.515595 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:30.515820 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:30.521172 (+ 5352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:30.521189 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:30.521212 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:30.521286 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:30.525565 (+ 4279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:30.526424 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:30.526434 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:30.526444 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:30.526690 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:30.527150 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:30.527155 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:30.527158 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:30.527943 (+ 785us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:30.528272 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:30.528740 (+ 468us) server_negotiation.cc:299] Negotiation successful
0808 23:34:30.529294 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":347,"threads_started":1}
I20260808 23:34:30.536329 6001 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d1a0ae7b8724e0191aca8be8d870e5c" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37603 } }
I20260808 23:34:30.536864 6001 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:34:30.537005 6001 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d1a0ae7b8724e0191aca8be8d870e5c, State: Initialized, Role: FOLLOWER
I20260808 23:34:30.537557 6001 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d1a0ae7b8724e0191aca8be8d870e5c" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37603 } }
I20260808 23:34:30.537784 6001 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:34:30.537941 6001 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:34:30.538142 6001 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:34:30.540625 6001 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d1a0ae7b8724e0191aca8be8d870e5c" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37603 } }
I20260808 23:34:30.541281 6001 leader_election.cc:302] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d1a0ae7b8724e0191aca8be8d870e5c; no voters:
I20260808 23:34:30.541944 6001 leader_election.cc:288] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:34:30.542220 6008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:34:30.543017 6008 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [term 1 LEADER]: Becoming Leader. State: Replica: 6d1a0ae7b8724e0191aca8be8d870e5c, State: Running, Role: LEADER
I20260808 23:34:30.543706 6008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d1a0ae7b8724e0191aca8be8d870e5c" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37603 } }
I20260808 23:34:30.544670 6001 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:34:30.547194 6010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d1a0ae7b8724e0191aca8be8d870e5c. Latest consensus state: current_term: 1 leader_uuid: "6d1a0ae7b8724e0191aca8be8d870e5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d1a0ae7b8724e0191aca8be8d870e5c" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37603 } } }
I20260808 23:34:30.547708 6010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [sys.catalog]: This master's current role is: LEADER
I20260808 23:34:30.548468 6009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d1a0ae7b8724e0191aca8be8d870e5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d1a0ae7b8724e0191aca8be8d870e5c" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 37603 } } }
I20260808 23:34:30.549132 6009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c [sys.catalog]: This master's current role is: LEADER
I20260808 23:34:30.549962 6018 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:34:30.556715 6018 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:34:30.566890 6018 catalog_manager.cc:1347] Generated new cluster ID: 7f291c5e02e5493e86a932d53fc7b2aa
I20260808 23:34:30.567106 6018 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:34:30.588833 6018 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:34:30.590494 6018 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:34:30.602259 6018 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c: Generated new TSK 0
I20260808 23:34:30.603296 6018 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:34:30.694591 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:37603
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:40851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:34:31.086299 6030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:31.086694 6030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:31.086863 6030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:31.094625 6030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:31.094815 6030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:31.095007 6030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:34:31.105922 6030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:40851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:37603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:31.107533 6030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:31.109035 6030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:31.123729 6035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:31.123903 6037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:31.123955 6039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:31.125435 6030 server_base.cc:1034] running on GCE node
I20260808 23:34:31.126255 6030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:31.127342 6030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:31.128584 6030 hybrid_clock.cc:648] HybridClock initialized: now 1786232071128539 us; error 46 us; skew 500 ppm
I20260808 23:34:31.128984 6030 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:34:31 dist-test-slave-1x4g krb5kdc[5911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232071, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:34:31.132539 6030 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:34:31.134315 6030 webserver.cc:460] Webserver started at http://127.26.207.193:33429/ using document root <none> and password file <none>
I20260808 23:34:31.135114 6030 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:31.135270 6030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:31.135614 6030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:34:31.139092 6030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "5c07bb85f4184a41bd03b324eee9ef28"
format_stamp: "Formatted at 2026-08-08 23:34:31 on dist-test-slave-1x4g"
server_key: "fe40d82e6e7efa2565c09cecc428a768"
server_key_iv: "d775bb4b8f7198cd06620eee850c25c7"
server_key_version: "encryptionkey@0"
I20260808 23:34:31.140038 6030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "5c07bb85f4184a41bd03b324eee9ef28"
format_stamp: "Formatted at 2026-08-08 23:34:31 on dist-test-slave-1x4g"
server_key: "fe40d82e6e7efa2565c09cecc428a768"
server_key_iv: "d775bb4b8f7198cd06620eee850c25c7"
server_key_version: "encryptionkey@0"
I20260808 23:34:31.146193 6030 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 23:34:31.150501 6047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:31.152057 6030 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 23:34:31.152274 6030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "5c07bb85f4184a41bd03b324eee9ef28"
format_stamp: "Formatted at 2026-08-08 23:34:31 on dist-test-slave-1x4g"
server_key: "fe40d82e6e7efa2565c09cecc428a768"
server_key_iv: "d775bb4b8f7198cd06620eee850c25c7"
server_key_version: "encryptionkey@0"
I20260808 23:34:31.152554 6030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:31.171326 6030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:31.176299 6030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:31.176707 6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:31.177860 6030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:34:31.179462 6030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:34:31.179577 6030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:31.179749 6030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:34:31.179823 6030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:31.216048 6030 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:40285
I20260808 23:34:31.216104 6165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:40285 every 8 connection(s)
I20260808 23:34:31.217545 6030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:34:31.223656 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 6030
I20260808 23:34:31.223918 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:34:31.224573 27455 external_mini_cluster.cc:1428] Setting key d46af2044454d00f4feab6c6ee028d42
Aug 08 23:34:31 dist-test-slave-1x4g krb5kdc[5911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232071, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:34:31.242841 6169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:31.220428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:46599 (local address 127.26.207.254:37603)
0808 23:34:31.220994 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:31.220998 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:31.222203 (+ 1205us) server_negotiation.cc:407] Connection header received
0808 23:34:31.224306 (+ 2103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:31.224312 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:31.224414 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:31.224538 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:31.226566 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:31.227652 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:31.229541 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:31.230273 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:31.230432 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:31.234675 (+ 4243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:31.234684 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:31.234692 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:31.234746 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:31.238757 (+ 4011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:31.239795 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:31.239804 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:31.239808 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:31.239981 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:31.240638 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:31.240643 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:31.240645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:31.241096 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:31.241254 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:31.242325 (+ 1071us) server_negotiation.cc:299] Negotiation successful
0808 23:34:31.242542 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":255,"threads_started":1}
I20260808 23:34:31.244562 6170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:31.221137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:37603 (local address 127.26.207.193:46599)
0808 23:34:31.221969 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:31.222015 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:31.223952 (+ 1937us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:31.224881 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:31.224892 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:31.225627 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:31.226350 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:31.226369 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:31.227861 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:31.227865 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:31.229349 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:31.229364 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:31.230557 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:31.230562 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:31.230784 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:31.231560 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:31.231593 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:31.234330 (+ 2737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:34:31.239001 (+ 4671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:34:31.239015 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:34:31.239037 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:34:31.239633 (+ 596us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:34:31.240103 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:34:31.240110 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:34:31.240115 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:34:31.240441 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:34:31.241250 (+ 809us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:34:31.241262 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:34:31.241817 (+ 555us) client_negotiation.cc:769] Sending connection context
0808 23:34:31.242165 (+ 348us) client_negotiation.cc:240] Negotiation successful
0808 23:34:31.242833 (+ 668us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":343,"threads_started":1}
I20260808 23:34:31.246480 6166 heartbeater.cc:347] Connected to a master server at 127.26.207.254:37603
I20260808 23:34:31.246857 6166 heartbeater.cc:464] Registering TS with master...
I20260808 23:34:31.247907 6166 heartbeater.cc:511] Master 127.26.207.254:37603 requested a full tablet report, sending...
I20260808 23:34:31.250631 5962 ts_manager.cc:194] Registered new tserver with Master: 5c07bb85f4184a41bd03b324eee9ef28 (127.26.207.193:40285)
I20260808 23:34:31.252262 5962 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:46599
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:34:31.301409 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:37603
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:40851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:34:31.682160 6173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:31.682551 6173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:31.682753 6173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:31.690599 6173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:31.690749 6173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:31.690869 6173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:34:31.702210 6173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:40851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:37603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:31.703809 6173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:31.705247 6173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:31.721843 6179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:31.721908 6181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:31.722440 6178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:31.723750 6173 server_base.cc:1034] running on GCE node
I20260808 23:34:31.724912 6173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:31.726122 6173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:31.727393 6173 hybrid_clock.cc:648] HybridClock initialized: now 1786232071727313 us; error 75 us; skew 500 ppm
I20260808 23:34:31.727775 6173 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:34:31 dist-test-slave-1x4g krb5kdc[5911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232071, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:34:31.731513 6173 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:34:31.733363 6173 webserver.cc:460] Webserver started at http://127.26.207.194:39237/ using document root <none> and password file <none>
I20260808 23:34:31.734272 6173 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:31.734440 6173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:31.734786 6173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:34:31.738199 6173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "5fc530a17bf94bceb288b1b58d46fe4b"
format_stamp: "Formatted at 2026-08-08 23:34:31 on dist-test-slave-1x4g"
server_key: "4a75ba9b0ce7a7917046d8ae22a4d947"
server_key_iv: "30ad133f3865b8614bcc6a042bc4fc93"
server_key_version: "encryptionkey@0"
I20260808 23:34:31.739214 6173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "5fc530a17bf94bceb288b1b58d46fe4b"
format_stamp: "Formatted at 2026-08-08 23:34:31 on dist-test-slave-1x4g"
server_key: "4a75ba9b0ce7a7917046d8ae22a4d947"
server_key_iv: "30ad133f3865b8614bcc6a042bc4fc93"
server_key_version: "encryptionkey@0"
I20260808 23:34:31.745359 6173 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 23:34:31.749548 6190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:31.751098 6173 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:34:31.751327 6173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "5fc530a17bf94bceb288b1b58d46fe4b"
format_stamp: "Formatted at 2026-08-08 23:34:31 on dist-test-slave-1x4g"
server_key: "4a75ba9b0ce7a7917046d8ae22a4d947"
server_key_iv: "30ad133f3865b8614bcc6a042bc4fc93"
server_key_version: "encryptionkey@0"
I20260808 23:34:31.751577 6173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:31.765125 6173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:31.769651 6173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:31.770006 6173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:31.771070 6173 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:34:31.772607 6173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:34:31.772717 6173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:31.772902 6173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:34:31.772962 6173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:31.809765 6173 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:42411
I20260808 23:34:31.809788 6309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:42411 every 8 connection(s)
I20260808 23:34:31.811220 6173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:34:31.815963 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 6173
I20260808 23:34:31.816224 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:34:31.816862 27455 external_mini_cluster.cc:1428] Setting key 605f90b126cd8dbb5a6cf284088ef36d
Aug 08 23:34:31 dist-test-slave-1x4g krb5kdc[5911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232071, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:34:31.837481 6312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:31.814230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:58319 (local address 127.26.207.254:37603)
0808 23:34:31.814773 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:31.814781 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:31.816131 (+ 1350us) server_negotiation.cc:407] Connection header received
0808 23:34:31.818675 (+ 2544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:31.818680 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:31.818771 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:31.818909 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:31.821374 (+ 2465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:31.822154 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:31.824873 (+ 2719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:31.825319 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:31.825424 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:31.830599 (+ 5175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:31.830609 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:31.830616 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:31.830668 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:31.833913 (+ 3245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:31.834810 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:31.834816 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:31.834822 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:31.834958 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:31.835461 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:31.835467 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:31.835472 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:31.835799 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:31.835978 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:31.836803 (+ 825us) server_negotiation.cc:299] Negotiation successful
0808 23:34:31.837097 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":257,"threads_started":1}
I20260808 23:34:31.838665 6313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:31.814945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:37603 (local address 127.26.207.194:58319)
0808 23:34:31.815894 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:31.815957 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:31.818352 (+ 2395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:31.819225 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:31.819238 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:31.820095 (+ 857us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:31.821067 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:31.821101 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:31.822366 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:31.822374 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:31.824641 (+ 2267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:31.824663 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:31.825599 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:31.825610 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:31.825991 (+ 381us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:31.826867 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:31.826905 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:31.830231 (+ 3326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:34:31.834110 (+ 3879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:34:31.834121 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:34:31.834141 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:34:31.834652 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:34:31.835093 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:34:31.835098 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:34:31.835103 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:34:31.835327 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:34:31.835949 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:34:31.835958 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:34:31.836349 (+ 391us) client_negotiation.cc:769] Sending connection context
0808 23:34:31.836661 (+ 312us) client_negotiation.cc:240] Negotiation successful
0808 23:34:31.837323 (+ 662us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":332,"threads_started":1}
I20260808 23:34:31.840363 6310 heartbeater.cc:347] Connected to a master server at 127.26.207.254:37603
I20260808 23:34:31.840714 6310 heartbeater.cc:464] Registering TS with master...
I20260808 23:34:31.841595 6310 heartbeater.cc:511] Master 127.26.207.254:37603 requested a full tablet report, sending...
I20260808 23:34:31.843407 5962 ts_manager.cc:194] Registered new tserver with Master: 5fc530a17bf94bceb288b1b58d46fe4b (127.26.207.194:42411)
I20260808 23:34:31.844866 5962 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:58319
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:34:31.892031 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:37603
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:40851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:34:32.256706 6166 heartbeater.cc:503] Master 127.26.207.254:37603 was elected leader, sending a full tablet report...
W20260808 23:34:32.264701 6316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:34:32.265115 6316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:34:32.265291 6316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:34:32.273063 6316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:34:32.273202 6316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:34:32.273389 6316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:34:32.285156 6316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:40851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:37603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:34:32.286614 6316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:34:32.288071 6316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:34:32.302920 6324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:32.302954 6321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:34:32.302919 6322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:34:32.304036 6316 server_base.cc:1034] running on GCE node
I20260808 23:34:32.304867 6316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:34:32.306001 6316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:34:32.307273 6316 hybrid_clock.cc:648] HybridClock initialized: now 1786232072307202 us; error 67 us; skew 500 ppm
I20260808 23:34:32.307672 6316 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:34:32 dist-test-slave-1x4g krb5kdc[5911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232072, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:34:32.315003 6316 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:34:32.316998 6316 webserver.cc:460] Webserver started at http://127.26.207.195:44193/ using document root <none> and password file <none>
I20260808 23:34:32.317852 6316 fs_manager.cc:359] Metadata directory not provided
I20260808 23:34:32.318045 6316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:34:32.318416 6316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:34:32.322227 6316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "4edac947265947e89a6787e3b053fd1f"
format_stamp: "Formatted at 2026-08-08 23:34:32 on dist-test-slave-1x4g"
server_key: "d43a733857cf2a75e1d6aa63a48940df"
server_key_iv: "a41b44f45369c8d07a1420a3011d95a9"
server_key_version: "encryptionkey@0"
I20260808 23:34:32.323246 6316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "4edac947265947e89a6787e3b053fd1f"
format_stamp: "Formatted at 2026-08-08 23:34:32 on dist-test-slave-1x4g"
server_key: "d43a733857cf2a75e1d6aa63a48940df"
server_key_iv: "a41b44f45369c8d07a1420a3011d95a9"
server_key_version: "encryptionkey@0"
I20260808 23:34:32.329536 6316 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260808 23:34:32.333551 6331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:32.335259 6316 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:34:32.335477 6316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "4edac947265947e89a6787e3b053fd1f"
format_stamp: "Formatted at 2026-08-08 23:34:32 on dist-test-slave-1x4g"
server_key: "d43a733857cf2a75e1d6aa63a48940df"
server_key_iv: "a41b44f45369c8d07a1420a3011d95a9"
server_key_version: "encryptionkey@0"
I20260808 23:34:32.335726 6316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:34:32.349332 6316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:34:32.354221 6316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:34:32.354571 6316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:34:32.355700 6316 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:34:32.357534 6316 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:34:32.357641 6316 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:32.357798 6316 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:34:32.357873 6316 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:34:32.394989 6316 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:45135
I20260808 23:34:32.395031 6452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:45135 every 8 connection(s)
I20260808 23:34:32.396420 6316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:34:32.406243 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 6316
I20260808 23:34:32.406497 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:34:32.406961 27455 external_mini_cluster.cc:1428] Setting key fe1059127de5005fcbfc80498ea36af5
Aug 08 23:34:32 dist-test-slave-1x4g krb5kdc[5911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232072, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:34:32.419409 6455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:32.399343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:46149 (local address 127.26.207.254:37603)
0808 23:34:32.399851 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:32.399856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:32.400815 (+ 959us) server_negotiation.cc:407] Connection header received
0808 23:34:32.402802 (+ 1987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:32.402808 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:32.402927 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:32.403055 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:32.404745 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.405654 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.407663 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.408179 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.408323 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:32.412764 (+ 4441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:32.412770 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:32.412861 (+ 91us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:32.412905 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:32.415741 (+ 2836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:32.416738 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:32.416744 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:32.416746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:32.416991 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:32.417492 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:32.417496 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:32.417498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:32.417837 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:32.417973 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:32.418874 (+ 901us) server_negotiation.cc:299] Negotiation successful
0808 23:34:32.419111 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":274,"threads_started":1}
I20260808 23:34:32.420447 6456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:32.399867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:37603 (local address 127.26.207.195:46149)
0808 23:34:32.400620 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:32.400668 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:32.402486 (+ 1818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:32.403331 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:32.403340 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:32.403906 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:34:32.404533 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:32.404553 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.405877 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.405882 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:32.407422 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:32.407444 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.408468 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.408476 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:32.408748 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:32.409675 (+ 927us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:34:32.409711 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:34:32.412486 (+ 2775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:34:32.415949 (+ 3463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:34:32.415961 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:34:32.415978 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:34:32.416551 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:34:32.417121 (+ 570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:34:32.417125 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:34:32.417127 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:34:32.417347 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:34:32.418018 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:34:32.418026 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:34:32.418433 (+ 407us) client_negotiation.cc:769] Sending connection context
0808 23:34:32.418728 (+ 295us) client_negotiation.cc:240] Negotiation successful
0808 23:34:32.419210 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":287,"threads_started":1}
I20260808 23:34:32.422570 6453 heartbeater.cc:347] Connected to a master server at 127.26.207.254:37603
I20260808 23:34:32.423017 6453 heartbeater.cc:464] Registering TS with master...
I20260808 23:34:32.424122 6453 heartbeater.cc:511] Master 127.26.207.254:37603 requested a full tablet report, sending...
I20260808 23:34:32.426302 5961 ts_manager.cc:194] Registered new tserver with Master: 4edac947265947e89a6787e3b053fd1f (127.26.207.195:45135)
I20260808 23:34:32.427229 5961 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:46149
I20260808 23:34:32.438133 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:34:32.457516 6455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:32.443504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36096 (local address 127.26.207.254:37603)
0808 23:34:32.443766 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:32.443774 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:32.444066 (+ 292us) server_negotiation.cc:407] Connection header received
0808 23:34:32.444231 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:32.444235 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:32.444306 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:32.444413 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:32.446217 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.446998 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.448388 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.448912 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.449040 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:32.451579 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:32.451585 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:32.451588 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:32.451628 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:32.454478 (+ 2850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:32.455281 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:32.455285 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:32.455287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:32.455443 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:32.455866 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:32.455870 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:32.455872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:32.456239 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:32.456559 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:32.456964 (+ 405us) server_negotiation.cc:299] Negotiation successful
0808 23:34:32.457165 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 23:34:32.462055 5961 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36096:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:34:32.469436 5961 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:34:32.533784 6471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:32.483567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:45135 (local address 127.0.0.1:53376)
0808 23:34:32.514754 (+ 31187us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:32.514825 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:32.515084 (+ 259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:32.519284 (+ 4200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:32.519297 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:32.519370 (+ 73us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:34:32.520075 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:32.520097 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.523269 (+ 3172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.523278 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:32.528131 (+ 4853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:32.528171 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.532222 (+ 4051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.532234 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:32.532646 (+ 412us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:32.532750 (+ 104us) client_negotiation.cc:769] Sending connection context
0808 23:34:32.533025 (+ 275us) client_negotiation.cc:240] Negotiation successful
0808 23:34:32.533298 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30761,"threads_started":1}
I20260808 23:34:32.535015 6469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:32.483773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53376 (local address 127.26.207.195:45135)
0808 23:34:32.517760 (+ 33987us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:32.517773 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:32.517823 (+ 50us) server_negotiation.cc:407] Connection header received
0808 23:34:32.517985 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:32.517999 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:32.518424 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:32.518777 (+ 353us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:34:32.520465 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.522963 (+ 2498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.528575 (+ 5612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.531267 (+ 2692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.531631 (+ 364us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:32.531943 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:32.534280 (+ 2337us) server_negotiation.cc:299] Negotiation successful
0808 23:34:32.534541 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33751,"thread_start_us":33564,"threads_started":1}
I20260808 23:34:32.541599 6384 tablet_service.cc:1467] Processing CreateTablet for tablet f2987f586d4941fda97f10feb8f71621 (DEFAULT_TABLE table=test-table [id=55b549263bdc460588d052b6ab787489]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:34:32.543503 6384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2987f586d4941fda97f10feb8f71621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:34:32.543663 6473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:32.484998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57832 (local address 127.26.207.193:40285)
0808 23:34:32.491651 (+ 6653us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:32.491665 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:32.534266 (+ 42601us) server_negotiation.cc:407] Connection header received
0808 23:34:32.534685 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:32.534696 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:32.535036 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:32.535261 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:34:32.536178 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.537891 (+ 1713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.540696 (+ 2805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.542454 (+ 1758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.542671 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:32.542874 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:32.543112 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 23:34:32.543299 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6415,"thread_start_us":6233,"threads_started":1}
I20260808 23:34:32.543556 6471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:32.484116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:40285 (local address 127.0.0.1:57832)
0808 23:34:32.534094 (+ 49978us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:32.534115 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:32.534438 (+ 323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:32.535457 (+ 1019us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:32.535465 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:32.535498 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:34:32.535721 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:32.535732 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.538149 (+ 2417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.538154 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:32.540472 (+ 2318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:32.540497 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.542644 (+ 2147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.542652 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:32.542839 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:32.542873 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 23:34:32.543031 (+ 158us) client_negotiation.cc:240] Negotiation successful
0808 23:34:32.543194 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49815,"mutex_wait_us":1,"thread_start_us":28694,"threads_started":1}
I20260808 23:34:32.545028 6470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:32.483916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:42411 (local address 127.0.0.1:42992)
0808 23:34:32.533597 (+ 49681us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:32.533633 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:32.534189 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:32.535696 (+ 1507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:32.535701 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:32.535726 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:34:32.537016 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:32.537035 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.539195 (+ 2160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.539202 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:32.541838 (+ 2636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:32.541856 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.544183 (+ 2327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.544192 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:32.544376 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:32.544409 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 23:34:32.544504 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 23:34:32.544649 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49427,"thread_start_us":49168,"threads_started":1}
I20260808 23:34:32.545173 6472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:32.484665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42992 (local address 127.26.207.194:42411)
0808 23:34:32.497630 (+ 12965us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:32.497647 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:32.533828 (+ 36181us) server_negotiation.cc:407] Connection header received
0808 23:34:32.534524 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:32.534539 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:32.534963 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:32.535262 (+ 299us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:34:32.537237 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.538955 (+ 1718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.542081 (+ 3126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.543646 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.543820 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:32.544006 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:32.544603 (+ 597us) server_negotiation.cc:299] Negotiation successful
0808 23:34:32.544815 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12686,"thread_start_us":12979,"threads_started":1}
I20260808 23:34:32.548431 6097 tablet_service.cc:1467] Processing CreateTablet for tablet f2987f586d4941fda97f10feb8f71621 (DEFAULT_TABLE table=test-table [id=55b549263bdc460588d052b6ab787489]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:34:32.549163 6241 tablet_service.cc:1467] Processing CreateTablet for tablet f2987f586d4941fda97f10feb8f71621 (DEFAULT_TABLE table=test-table [id=55b549263bdc460588d052b6ab787489]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:34:32.550050 6097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2987f586d4941fda97f10feb8f71621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:34:32.550647 6241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2987f586d4941fda97f10feb8f71621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:34:32.560572 6474 tablet_bootstrap.cc:492] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f: Bootstrap starting.
I20260808 23:34:32.565133 6474 tablet_bootstrap.cc:654] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f: Neither blocks nor log segments found. Creating new log.
I20260808 23:34:32.567119 6475 tablet_bootstrap.cc:492] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b: Bootstrap starting.
I20260808 23:34:32.567123 6474 log.cc:824] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f: Log is configured to *not* fsync() on all Append() calls
I20260808 23:34:32.570076 6477 tablet_bootstrap.cc:492] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28: Bootstrap starting.
I20260808 23:34:32.571520 6475 tablet_bootstrap.cc:654] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b: Neither blocks nor log segments found. Creating new log.
I20260808 23:34:32.571615 6474 tablet_bootstrap.cc:492] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f: No bootstrap required, opened a new log
I20260808 23:34:32.571951 6474 ts_tablet_manager.cc:1397] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260808 23:34:32.573089 6475 log.cc:824] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b: Log is configured to *not* fsync() on all Append() calls
I20260808 23:34:32.574259 6477 tablet_bootstrap.cc:654] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28: Neither blocks nor log segments found. Creating new log.
I20260808 23:34:32.575520 6477 log.cc:824] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28: Log is configured to *not* fsync() on all Append() calls
I20260808 23:34:32.577384 6475 tablet_bootstrap.cc:492] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b: No bootstrap required, opened a new log
I20260808 23:34:32.577723 6475 ts_tablet_manager.cc:1397] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.007s
I20260808 23:34:32.579072 6477 tablet_bootstrap.cc:492] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28: No bootstrap required, opened a new log
I20260808 23:34:32.579408 6477 ts_tablet_manager.cc:1397] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 23:34:32.581301 6474 raft_consensus.cc:348] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edac947265947e89a6787e3b053fd1f" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 45135 } } peers { permanent_uuid: "5fc530a17bf94bceb288b1b58d46fe4b" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42411 } } peers { permanent_uuid: "5c07bb85f4184a41bd03b324eee9ef28" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 40285 } }
I20260808 23:34:32.581801 6474 raft_consensus.cc:374] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:34:32.581905 6474 raft_consensus.cc:729] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4edac947265947e89a6787e3b053fd1f, State: Initialized, Role: FOLLOWER
I20260808 23:34:32.582785 6474 consensus_queue.cc:260] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edac947265947e89a6787e3b053fd1f" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 45135 } } peers { permanent_uuid: "5fc530a17bf94bceb288b1b58d46fe4b" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42411 } } peers { permanent_uuid: "5c07bb85f4184a41bd03b324eee9ef28" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 40285 } }
I20260808 23:34:32.584605 6453 heartbeater.cc:503] Master 127.26.207.254:37603 was elected leader, sending a full tablet report...
I20260808 23:34:32.585528 6474 ts_tablet_manager.cc:1428] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260808 23:34:32.589531 6475 raft_consensus.cc:348] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edac947265947e89a6787e3b053fd1f" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 45135 } } peers { permanent_uuid: "5fc530a17bf94bceb288b1b58d46fe4b" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42411 } } peers { permanent_uuid: "5c07bb85f4184a41bd03b324eee9ef28" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 40285 } }
I20260808 23:34:32.590106 6475 raft_consensus.cc:374] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:34:32.590216 6475 raft_consensus.cc:729] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fc530a17bf94bceb288b1b58d46fe4b, State: Initialized, Role: FOLLOWER
I20260808 23:34:32.590956 6475 consensus_queue.cc:260] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edac947265947e89a6787e3b053fd1f" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 45135 } } peers { permanent_uuid: "5fc530a17bf94bceb288b1b58d46fe4b" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42411 } } peers { permanent_uuid: "5c07bb85f4184a41bd03b324eee9ef28" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 40285 } }
I20260808 23:34:32.591069 6477 raft_consensus.cc:348] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edac947265947e89a6787e3b053fd1f" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 45135 } } peers { permanent_uuid: "5fc530a17bf94bceb288b1b58d46fe4b" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42411 } } peers { permanent_uuid: "5c07bb85f4184a41bd03b324eee9ef28" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 40285 } }
I20260808 23:34:32.591538 6477 raft_consensus.cc:374] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:34:32.591686 6477 raft_consensus.cc:729] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c07bb85f4184a41bd03b324eee9ef28, State: Initialized, Role: FOLLOWER
I20260808 23:34:32.592621 6477 consensus_queue.cc:260] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edac947265947e89a6787e3b053fd1f" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 45135 } } peers { permanent_uuid: "5fc530a17bf94bceb288b1b58d46fe4b" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42411 } } peers { permanent_uuid: "5c07bb85f4184a41bd03b324eee9ef28" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 40285 } }
I20260808 23:34:32.593675 6310 heartbeater.cc:503] Master 127.26.207.254:37603 was elected leader, sending a full tablet report...
I20260808 23:34:32.594492 6475 ts_tablet_manager.cc:1428] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b: Time spent starting tablet: real 0.017s user 0.013s sys 0.004s
I20260808 23:34:32.600039 6477 ts_tablet_manager.cc:1428] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28: Time spent starting tablet: real 0.020s user 0.020s sys 0.000s
W20260808 23:34:32.648237 6454 tablet.cc:2369] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:34:32.652281 6482 raft_consensus.cc:482] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:34:32.652642 6482 raft_consensus.cc:504] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edac947265947e89a6787e3b053fd1f" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 45135 } } peers { permanent_uuid: "5fc530a17bf94bceb288b1b58d46fe4b" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42411 } } peers { permanent_uuid: "5c07bb85f4184a41bd03b324eee9ef28" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 40285 } }
I20260808 23:34:32.654567 6482 leader_election.cc:288] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4edac947265947e89a6787e3b053fd1f (127.26.207.195:45135), 5c07bb85f4184a41bd03b324eee9ef28 (127.26.207.193:40285)
I20260808 23:34:32.662537 6473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:32.655372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:41047 (local address 127.26.207.193:40285)
0808 23:34:32.655588 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:32.655594 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:32.656284 (+ 690us) server_negotiation.cc:407] Connection header received
0808 23:34:32.656479 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:32.656483 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:32.656549 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:32.656656 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:34:32.657386 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.658241 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.660403 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.661418 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.661581 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:32.661642 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:32.662099 (+ 457us) server_negotiation.cc:299] Negotiation successful
0808 23:34:32.662260 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 23:34:32.662802 6485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:32.655131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:40285 (local address 127.26.207.194:41047)
0808 23:34:32.656164 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:32.656185 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:32.656339 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:32.656666 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:32.656715 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:32.656744 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:34:32.657198 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:32.657211 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.658385 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.658391 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:32.660155 (+ 1764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:32.660176 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.661682 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.661689 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:32.661888 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:32.661931 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 23:34:32.662062 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 23:34:32.662185 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":868,"mutex_wait_us":7,"thread_start_us":614,"threads_started":1}
I20260808 23:34:32.662892 6469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:32.654942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:36035 (local address 127.26.207.195:45135)
0808 23:34:32.655188 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:32.655195 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:32.656041 (+ 846us) server_negotiation.cc:407] Connection header received
0808 23:34:32.656445 (+ 404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:32.656452 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:32.656566 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:32.656679 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:34:32.657614 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.658471 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.660714 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.661709 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.661889 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:32.661962 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:32.662380 (+ 418us) server_negotiation.cc:299] Negotiation successful
0808 23:34:32.662579 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260808 23:34:32.663411 6484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:32.654882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:45135 (local address 127.26.207.194:36035)
0808 23:34:32.655894 (+ 1012us) negotiation.cc:107] Waiting for socket to connect
0808 23:34:32.655920 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 23:34:32.656227 (+ 307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:34:32.656722 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:34:32.656726 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:34:32.656883 (+ 157us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:34:32.657451 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:32.657467 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.658650 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.658653 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:32.660511 (+ 1858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:34:32.660527 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.661945 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.661950 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:34:32.662173 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:32.662209 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 23:34:32.662310 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 23:34:32.662457 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":795,"spinlock_wait_cycles":94208,"thread_start_us":524,"threads_started":1}
I20260808 23:34:32.664206 6117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2987f586d4941fda97f10feb8f71621" candidate_uuid: "5fc530a17bf94bceb288b1b58d46fe4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c07bb85f4184a41bd03b324eee9ef28" is_pre_election: true
I20260808 23:34:32.664474 6405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2987f586d4941fda97f10feb8f71621" candidate_uuid: "5fc530a17bf94bceb288b1b58d46fe4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4edac947265947e89a6787e3b053fd1f" is_pre_election: true
I20260808 23:34:32.664873 6117 raft_consensus.cc:2454] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fc530a17bf94bceb288b1b58d46fe4b in term 0.
I20260808 23:34:32.665131 6405 raft_consensus.cc:2454] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fc530a17bf94bceb288b1b58d46fe4b in term 0.
I20260808 23:34:32.665700 6191 leader_election.cc:302] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c07bb85f4184a41bd03b324eee9ef28, 5fc530a17bf94bceb288b1b58d46fe4b; no voters:
I20260808 23:34:32.666153 6482 raft_consensus.cc:2781] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:34:32.666325 6482 raft_consensus.cc:482] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:34:32.666450 6482 raft_consensus.cc:3037] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:34:32.669193 6482 raft_consensus.cc:504] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edac947265947e89a6787e3b053fd1f" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 45135 } } peers { permanent_uuid: "5fc530a17bf94bceb288b1b58d46fe4b" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42411 } } peers { permanent_uuid: "5c07bb85f4184a41bd03b324eee9ef28" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 40285 } }
I20260808 23:34:32.669857 6482 leader_election.cc:288] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [CANDIDATE]: Term 1 election: Requested vote from peers 4edac947265947e89a6787e3b053fd1f (127.26.207.195:45135), 5c07bb85f4184a41bd03b324eee9ef28 (127.26.207.193:40285)
I20260808 23:34:32.670435 6405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2987f586d4941fda97f10feb8f71621" candidate_uuid: "5fc530a17bf94bceb288b1b58d46fe4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4edac947265947e89a6787e3b053fd1f"
I20260808 23:34:32.670481 6117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2987f586d4941fda97f10feb8f71621" candidate_uuid: "5fc530a17bf94bceb288b1b58d46fe4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c07bb85f4184a41bd03b324eee9ef28"
I20260808 23:34:32.670660 6405 raft_consensus.cc:3037] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:34:32.670756 6117 raft_consensus.cc:3037] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:34:32.673255 6405 raft_consensus.cc:2454] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fc530a17bf94bceb288b1b58d46fe4b in term 1.
I20260808 23:34:32.673264 6117 raft_consensus.cc:2454] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fc530a17bf94bceb288b1b58d46fe4b in term 1.
I20260808 23:34:32.673821 6191 leader_election.cc:302] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c07bb85f4184a41bd03b324eee9ef28, 5fc530a17bf94bceb288b1b58d46fe4b; no voters:
I20260808 23:34:32.674208 6482 raft_consensus.cc:2781] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:34:32.674711 6482 raft_consensus.cc:686] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [term 1 LEADER]: Becoming Leader. State: Replica: 5fc530a17bf94bceb288b1b58d46fe4b, State: Running, Role: LEADER
I20260808 23:34:32.675243 6482 consensus_queue.cc:237] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edac947265947e89a6787e3b053fd1f" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 45135 } } peers { permanent_uuid: "5fc530a17bf94bceb288b1b58d46fe4b" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42411 } } peers { permanent_uuid: "5c07bb85f4184a41bd03b324eee9ef28" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 40285 } }
I20260808 23:34:32.680590 5961 catalog_manager.cc:5495] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fc530a17bf94bceb288b1b58d46fe4b (127.26.207.194). New cstate: current_term: 1 leader_uuid: "5fc530a17bf94bceb288b1b58d46fe4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edac947265947e89a6787e3b053fd1f" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 45135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fc530a17bf94bceb288b1b58d46fe4b" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c07bb85f4184a41bd03b324eee9ef28" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 40285 } health_report { overall_health: UNKNOWN } } }
I20260808 23:34:32.712134 6472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:32.706533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43006 (local address 127.26.207.194:42411)
0808 23:34:32.706751 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:32.706756 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:32.706775 (+ 19us) server_negotiation.cc:407] Connection header received
0808 23:34:32.706874 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:32.706878 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:32.706958 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:32.707107 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:34:32.707454 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.708245 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.709724 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.710171 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.710280 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:32.710824 (+ 544us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:34:32.711403 (+ 579us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:34:32.711577 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:32.711702 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 23:34:32.711786 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260808 23:34:32.720499 6167 tablet.cc:2369] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:34:32.721601 6117 raft_consensus.cc:1261] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28 [term 1 FOLLOWER]: Refusing update from remote peer 5fc530a17bf94bceb288b1b58d46fe4b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:34:32.721653 6405 raft_consensus.cc:1261] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f [term 1 FOLLOWER]: Refusing update from remote peer 5fc530a17bf94bceb288b1b58d46fe4b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:34:32.722729 6486 consensus_queue.cc:1035] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c07bb85f4184a41bd03b324eee9ef28" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:34:32.723135 6482 consensus_queue.cc:1035] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4edac947265947e89a6787e3b053fd1f" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 45135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:34:32.736049 6489 mvcc.cc:205] Tried to move back new op lower bound from 7316406569855266816 to 7316406569682157568. Current Snapshot: MvccSnapshot[applied={T|T < 7316406569855266816}]
I20260808 23:34:32.736856 6490 mvcc.cc:205] Tried to move back new op lower bound from 7316406569855266816 to 7316406569682157568. Current Snapshot: MvccSnapshot[applied={T|T < 7316406569855266816}]
I20260808 23:34:32.753762 5962 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:34:32.754045 5962 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:34:32.758203 5962 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6d1a0ae7b8724e0191aca8be8d870e5c: Sending DeleteTablet for 3 replicas of tablet f2987f586d4941fda97f10feb8f71621
I20260808 23:34:32.759625 6384 tablet_service.cc:1514] Processing DeleteTablet for tablet f2987f586d4941fda97f10feb8f71621 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:34:32 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:53376
I20260808 23:34:32.759631 6241 tablet_service.cc:1514] Processing DeleteTablet for tablet f2987f586d4941fda97f10feb8f71621 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:34:32 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:42992
I20260808 23:34:32.759635 6097 tablet_service.cc:1514] Processing DeleteTablet for tablet f2987f586d4941fda97f10feb8f71621 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:34:32 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:57832
I20260808 23:34:32.767867 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 6030
I20260808 23:34:32.793980 6501 tablet_replica.cc:330] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f: stopping tablet replica
I20260808 23:34:32.794737 6501 raft_consensus.cc:2229] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:34:32.795508 6501 raft_consensus.cc:2258] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:34:32.796557 6502 tablet_replica.cc:330] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28: stopping tablet replica
I20260808 23:34:32.797268 6502 raft_consensus.cc:2229] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:34:32.797981 6502 raft_consensus.cc:2258] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:34:32.799227 6501 ts_tablet_manager.cc:1905] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:34:32.800817 6502 ts_tablet_manager.cc:1905] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:34:32.803869 6499 tablet_replica.cc:330] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b: stopping tablet replica
I20260808 23:34:32.805357 6499 raft_consensus.cc:2229] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:34:32.806246 6499 raft_consensus.cc:2258] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:34:32.808765 6499 ts_tablet_manager.cc:1905] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:34:32.809491 6501 ts_tablet_manager.cc:1918] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:34:32.809782 6501 log.cc:1196] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/f2987f586d4941fda97f10feb8f71621
I20260808 23:34:32.810843 6501 ts_tablet_manager.cc:1939] T f2987f586d4941fda97f10feb8f71621 P 4edac947265947e89a6787e3b053fd1f: Deleting consensus metadata
I20260808 23:34:32.813141 5948 catalog_manager.cc:4841] TS 4edac947265947e89a6787e3b053fd1f (127.26.207.195:45135): tablet f2987f586d4941fda97f10feb8f71621 (table test-table [id=55b549263bdc460588d052b6ab787489]) successfully deleted
Aug 08 23:34:32 dist-test-slave-1x4g krb5kdc[5911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:34:32.815196 6502 ts_tablet_manager.cc:1918] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:34:32.815457 6502 log.cc:1196] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/f2987f586d4941fda97f10feb8f71621
I20260808 23:34:32.816095 6502 ts_tablet_manager.cc:1939] T f2987f586d4941fda97f10feb8f71621 P 5c07bb85f4184a41bd03b324eee9ef28: Deleting consensus metadata
I20260808 23:34:32.817729 6499 ts_tablet_manager.cc:1918] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:34:32.817924 6499 log.cc:1196] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/f2987f586d4941fda97f10feb8f71621
I20260808 23:34:32.818400 5945 catalog_manager.cc:4841] TS 5c07bb85f4184a41bd03b324eee9ef28 (127.26.207.193:40285): tablet f2987f586d4941fda97f10feb8f71621 (table test-table [id=55b549263bdc460588d052b6ab787489]) successfully deleted
I20260808 23:34:32.818549 6499 ts_tablet_manager.cc:1939] T f2987f586d4941fda97f10feb8f71621 P 5fc530a17bf94bceb288b1b58d46fe4b: Deleting consensus metadata
I20260808 23:34:32.820271 5946 catalog_manager.cc:4841] TS 5fc530a17bf94bceb288b1b58d46fe4b (127.26.207.194:42411): tablet f2987f586d4941fda97f10feb8f71621 (table test-table [id=55b549263bdc460588d052b6ab787489]) successfully deleted
I20260808 23:34:32.823741 6473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:32.769502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57838 (local address 127.26.207.193:40285)
0808 23:34:32.769780 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:32.769790 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:32.784606 (+ 14816us) server_negotiation.cc:407] Connection header received
0808 23:34:32.785322 (+ 716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:32.785333 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:32.785455 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:32.785574 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:32.788515 (+ 2941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.790256 (+ 1741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.801130 (+ 10874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.802133 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.802354 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:32.815275 (+ 12921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:32.815298 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:32.815319 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:32.815375 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:32.819895 (+ 4520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:32.821357 (+ 1462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:32.821369 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:32.821373 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:32.821589 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:32.822000 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:32.822005 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:32.822008 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:32.822526 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:32.822883 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:32.823063 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 23:34:32.823331 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 23:34:32.824506 6161 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:32.938408 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 6030
I20260808 23:34:32.962755 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 6173
Aug 08 23:34:32 dist-test-slave-1x4g krb5kdc[5911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:34:32.980433 6472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:32.963971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43022 (local address 127.26.207.194:42411)
0808 23:34:32.964190 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:32.964195 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:32.964212 (+ 17us) server_negotiation.cc:407] Connection header received
0808 23:34:32.964273 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:32.964277 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:32.964338 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:32.964460 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:32.965819 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.966673 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.968004 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:32.968445 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:32.968625 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:32.973081 (+ 4456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:32.973099 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:32.973120 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:32.973167 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:32.976583 (+ 3416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:32.977611 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:32.977619 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:32.977621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:32.977799 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:32.978250 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:32.978254 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:32.978256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:32.978668 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:32.979079 (+ 411us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:32.979723 (+ 644us) server_negotiation.cc:299] Negotiation successful
0808 23:34:32.980009 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 23:34:32.981410 6305 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:33.126960 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 6173
I20260808 23:34:33.150817 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 6316
Aug 08 23:34:33 dist-test-slave-1x4g krb5kdc[5911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:34:33.166944 6469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:34:33.151637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53388 (local address 127.26.207.195:45135)
0808 23:34:33.151822 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 23:34:33.151827 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:34:33.151847 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:34:33.151983 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:34:33.151987 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:34:33.152058 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:34:33.152156 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:34:33.153582 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:33.154324 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:33.155549 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:34:33.155936 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:34:33.156034 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:34:33.160677 (+ 4643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:34:33.160695 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:34:33.160714 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:34:33.160757 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:34:33.163842 (+ 3085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:33.164688 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:33.164696 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:33.164699 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:33.164957 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:34:33.165317 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:34:33.165321 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:34:33.165323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:34:33.165722 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:34:33.165984 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0808 23:34:33.166324 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 23:34:33.166581 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 23:34:33.167735 6447 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:33.260767 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 6316
I20260808 23:34:33.282966 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 5926
I20260808 23:34:33.284314 5996 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:34:33.400254 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 5926
2026-08-08T23:34:33Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4919 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:34:33 dist-test-slave-1x4g krb5kdc[6511](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:34:33 dist-test-slave-1x4g krb5kdc[6511](info): set up 2 sockets
Aug 08 23:34:33 dist-test-slave-1x4g krb5kdc[6511](info): commencing operation
krb5kdc: starting...
W20260808 23:34:34.586000 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.003s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:34:34 dist-test-slave-1x4g krb5kdc[6511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232074, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:34:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:34:34Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.207.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.207.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.207.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/rangeradmin_127.26.207.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.207.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/rangeradmin_127.26.207.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.207.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.207.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.207.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/rangerlookup_127.26.207.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.207.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/rangerlookup_127.26.207.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.207.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.207.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.207.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/HTTP_127.26.207.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.207.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/HTTP_127.26.207.212@KRBTEST.COM.keytab.
I20260808 23:34:35.064735 27455 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskWgS6PY/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/postgres -l logfile start
2026-08-08 23:34:37.943 UTC [6546] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 23:34:37.943 UTC [6546] LOG: listening on IPv4 address "127.26.207.212", port 46125
2026-08-08 23:34:37.947 UTC [6546] LOG: listening on Unix socket "/tmp/.s.PGSQL.46125"
2026-08-08 23:34:37.973 UTC [6548] LOG: database system was shut down at 2026-08-08 23:34:36 UTC
2026-08-08 23:34:37.977 UTC [6546] LOG: database system is ready to accept connections
I20260808 23:34:39.001071 27455 mini_postgres.cc:96] Postgres bound to 46125
2026-08-08 23:34:39.028 UTC [6558] FATAL: database "slave" does not exist
127.26.207.212:46125 - accepting connections
I20260808 23:34:39.028977 27455 mini_ranger.cc:161] Starting Ranger...
I20260808 23:34:39.066660 27455 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 23:34:39.659933 27455 mini_ranger.cc:87] Created ranger Postgres database
I20260808 23:34:39.660058 27455 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-admin
2026-08-08 23:34:40,033 [I] DB FLAVOR :POSTGRES
2026-08-08 23:34:40,034 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 23:34:40,034 [I] Checking connection..
2026-08-08 23:34:40,034 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 23:34:40,306 [I] Checking connection passed.
2026-08-08 23:34:40,307 [I] --------- Verifying version history table ---------
2026-08-08 23:34:40,307 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 23:34:40,571 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 23:34:40,572 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 23:34:40,853 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 23:34:40,854 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 23:34:40,854 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 23:34:41.096 UTC [6628] WARNING: there is no transaction in progress
2026-08-08 23:34:41,104 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 23:34:41,104 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 23:34:41,354 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 23:34:41,354 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 23:34:41,355 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 23:34:41,618 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 23:34:41,886 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-1x4g.c.gcp-upstream.internal','N') ;"
2026-08-08 23:34:42,156 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 23:34:42,437 [I] Table x_portal_user does not exist in database ranger
2026-08-08 23:34:42,437 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 23:34:42,719 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 23:34:42,719 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 23:34:42,997 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 23:34:43,294 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 23:34:43,294 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 23:34:44.408 UTC [6753] WARNING: there is no transaction in progress
2026-08-08 23:34:44.428 UTC [6753] WARNING: there is no transaction in progress
2026-08-08 23:34:44.447 UTC [6753] WARNING: there is no transaction in progress
2026-08-08 23:34:44.466 UTC [6753] WARNING: there is no transaction in progress
2026-08-08 23:34:44.486 UTC [6753] WARNING: there is no transaction in progress
2026-08-08 23:34:44.508 UTC [6753] WARNING: there is no transaction in progress
2026-08-08 23:34:44.578 UTC [6753] WARNING: there is no transaction in progress
2026-08-08 23:34:44.586 UTC [6753] WARNING: there is no transaction in progress
2026-08-08 23:34:44.603 UTC [6753] WARNING: there is no transaction in progress
2026-08-08 23:34:44.616 UTC [6753] WARNING: there is no transaction in progress
2026-08-08 23:34:44.629 UTC [6753] WARNING: there is no transaction in progress
2026-08-08 23:34:44.646 UTC [6753] WARNING: there is no transaction in progress
2026-08-08 23:34:44.657 UTC [6753] WARNING: there is no transaction in progress
2026-08-08 23:34:44.665 UTC [6753] WARNING: there is no transaction in progress
2026-08-08 23:34:44.674 UTC [6753] WARNING: there is no transaction in progress
2026-08-08 23:34:44.683 UTC [6753] WARNING: there is no transaction in progress
2026-08-08 23:34:45,527 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 23:34:45,528 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 23:34:45,791 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 23:34:45,792 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 23:34:46,043 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 23:34:46,043 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 23:34:46,295 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 23:34:46,295 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 23:34:46,552 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 23:34:46,802 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-1x4g.c.gcp-upstream.internal';"
2026-08-08 23:34:47,073 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 23:34:47,073 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 23:34:47,333 [I] DB_PATCHES have already been applied
I20260808 23:34:47.339972 27455 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-admin:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskWgS6PY/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 23:34:47.340108 27455 mini_ranger.cc:193] Using host: 127.26.207.212
I20260808 23:34:47.366194 27455 mini_ranger.cc:227] Ranger admin URL: http://127.26.207.212:58769
Aug 08, 2026 11:34:47 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 11:34:47 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 11:34:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 11:34:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 11:34:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 11:34:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 11:34:48 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 23:34:48.575271 27455 mini_ranger.cc:160] Time spent starting Ranger: real 9.546s user 0.003s sys 0.077s
Aug 08, 2026 11:35:11 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 11:35:11 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 11:35:11 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 11:35:11 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 11:35:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 11:35:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 11:35:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 11:35:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 11:35:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 11:35:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 11:35:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 11:35:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 11:35:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 11:35:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 11:35:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 11:35:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 11:35:11 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 11:35:12 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 23:35:13.266388 27455 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.207.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.207.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.207.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/rangerkms_127.26.207.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.207.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/rangerkms_127.26.207.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.207.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.207.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.207.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/HTTP_127.26.207.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.207.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/HTTP_127.26.207.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 23:35:13 dist-test-slave-1x4g krb5kdc[6511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232113, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 23:35:13.524904 27455 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 23:35:13.556963 27455 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 23:35:14.677153 27455 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 23:35:14.677357 27455 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-kms
I20260808 23:35:14.677500 27455 mini_ranger_kms.cc:227] Using postgres at 127.26.207.212:46125
2026-08-08 23:35:15,179 [I] DB FLAVOR :POSTGRES
2026-08-08 23:35:15,180 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 23:35:15,180 [I] Checking connection
2026-08-08 23:35:15,180 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 23:35:15,490 [I] connection success
2026-08-08 23:35:15,490 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 23:35:15,490 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 23:35:15,490 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 23:35:15,797 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 23:35:15,797 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 23:35:15,798 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 23:35:15,798 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:46125/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 23:35:16,147 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 23:35:16.656565 27455 mini_ranger_kms.cc:310] Created kms service
I20260808 23:35:16.905673 27455 mini_ranger_kms.cc:326] Created kudu user
I20260808 23:35:16.958076 27455 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 23:35:16 dist-test-slave-1x4g krb5kdc[6511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232113, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:35:17.416115 27455 mini_ranger_kms.cc:384] Added ranger policy
I20260808 23:35:17.417716 27455 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-kms:/tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 23:35:17.417809 27455 mini_ranger_kms.cc:240] Using host: 127.26.207.212
I20260808 23:35:17.450922 27455 mini_ranger_kms.cc:276] Ranger KMS PID: 6956
I20260808 23:35:17.451153 27455 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.207.212:39741
Aug 08, 2026 11:35:18 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 11:35:18 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 11:35:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 11:35:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 11:35:19 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 11:35:19 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 23:35:19 dist-test-slave-1x4g krb5kdc[6511](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786232119, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.207.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:35:19.990200 27455 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.465s user 0.130s sys 0.432s
I20260808 23:35:19.990588 27455 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 23:35:19.990808 27455 mini_ranger_kms.cc:401] 127.26.207.212:39741/kms/v1/keys
Aug 08 23:35:20 dist-test-slave-1x4g krb5kdc[6511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232119, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.207.212@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
Aug 08 23:35:20 dist-test-slave-1x4g krb5kdc[6511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232119, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.207.212@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
Aug 08 23:35:23 dist-test-slave-1x4g krb5kdc[6511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:35:23.338181 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:36531
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:36531
--ranger_config_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.207.212:39741/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:35:23.754861 7011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:35:23.755208 7011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:35:23.755307 7011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:35:23.763182 7011 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:35:23.763329 7011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:35:23.763378 7011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:35:23.763444 7011 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:35:23.763559 7011 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:35:23.774838 7011 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.207.212:39741/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:36531
--ranger_config_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:36531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:35:23.776259 7011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:35:23.777717 7011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:35:23.791177 7016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:35:23.791147 7019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:35:23.791201 7017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:35:23.792408 7011 server_base.cc:1034] running on GCE node
I20260808 23:35:23.793474 7011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:35:23.795156 7011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:35:23.796397 7011 hybrid_clock.cc:648] HybridClock initialized: now 1786232123796354 us; error 35 us; skew 500 ppm
I20260808 23:35:23.796919 7011 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:35:23 dist-test-slave-1x4g krb5kdc[6511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232123, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:35:23.800573 7011 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:35:23.802429 7011 webserver.cc:460] Webserver started at http://127.26.207.254:45573/ using document root <none> and password file <none>
I20260808 23:35:23.803241 7011 fs_manager.cc:359] Metadata directory not provided
I20260808 23:35:23.803366 7011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:35:23.803751 7011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 23:35:23 dist-test-slave-1x4g krb5kdc[6511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232123, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:35:23.868371 7011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "14295e2168424d6eaf5910e417d5cb62"
format_stamp: "Formatted at 2026-08-08 23:35:23 on dist-test-slave-1x4g"
server_key: "8b4925818caf626b947d7737fc669d83"
server_key_iv: "0eac77ef94eaa60c66891a3332daa55e"
server_key_version: "kuduclusterkey@0"
I20260808 23:35:23.869688 7011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "14295e2168424d6eaf5910e417d5cb62"
format_stamp: "Formatted at 2026-08-08 23:35:23 on dist-test-slave-1x4g"
server_key: "8b4925818caf626b947d7737fc669d83"
server_key_iv: "0eac77ef94eaa60c66891a3332daa55e"
server_key_version: "kuduclusterkey@0"
I20260808 23:35:23.878191 7011 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.003s sys 0.005s
I20260808 23:35:23.901991 7026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:35:23.904074 7011 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.004s
I20260808 23:35:23.904321 7011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "14295e2168424d6eaf5910e417d5cb62"
format_stamp: "Formatted at 2026-08-08 23:35:23 on dist-test-slave-1x4g"
server_key: "8b4925818caf626b947d7737fc669d83"
server_key_iv: "0eac77ef94eaa60c66891a3332daa55e"
server_key_version: "kuduclusterkey@0"
I20260808 23:35:23.904631 7011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:35:23.934856 7011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:35:23.939700 7011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:35:23.940071 7011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:35:23.960656 7011 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:36531
I20260808 23:35:23.960680 7086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:36531 every 8 connection(s)
I20260808 23:35:23.962258 7011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:35:23.966486 7087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:35:23.968472 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 7011
I20260808 23:35:23.968698 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:35:23.969614 27455 external_mini_cluster.cc:1428] Setting key a1630faba6854841be575d1dd64cb7a9
I20260808 23:35:23.980930 7087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62: Bootstrap starting.
I20260808 23:35:23.985505 7087 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62: Neither blocks nor log segments found. Creating new log.
Aug 08 23:35:23 dist-test-slave-1x4g krb5kdc[6511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:35:23.986743 7087 log.cc:824] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62: Log is configured to *not* fsync() on all Append() calls
I20260808 23:35:23.990372 7087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62: No bootstrap required, opened a new log
I20260808 23:35:23.995488 7090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:23.972172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42070 (local address 127.26.207.254:36531)
0808 23:35:23.973214 (+ 1042us) server_negotiation.cc:206] Beginning negotiation
0808 23:35:23.973228 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:35:23.973281 (+ 53us) server_negotiation.cc:407] Connection header received
0808 23:35:23.975128 (+ 1847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:35:23.975156 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:35:23.975608 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:35:23.976005 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:35:23.977847 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:23.979392 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:23.981333 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:23.982078 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:23.982244 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:23.987121 (+ 4877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:35:23.987131 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:35:23.987148 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:35:23.987199 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:35:23.990798 (+ 3599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:35:23.991653 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:35:23.991665 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:35:23.991672 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:35:23.991840 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:35:23.992294 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:35:23.992298 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:35:23.992301 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:35:23.993000 (+ 699us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:35:23.993384 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0808 23:35:23.993853 (+ 469us) server_negotiation.cc:299] Negotiation successful
0808 23:35:23.994311 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":795,"thread_start_us":526,"threads_started":1}
I20260808 23:35:24.000078 7087 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14295e2168424d6eaf5910e417d5cb62" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36531 } }
I20260808 23:35:24.000541 7087 raft_consensus.cc:374] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:35:24.000664 7087 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14295e2168424d6eaf5910e417d5cb62, State: Initialized, Role: FOLLOWER
I20260808 23:35:24.001325 7087 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14295e2168424d6eaf5910e417d5cb62" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36531 } }
I20260808 23:35:24.001626 7087 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:35:24.001796 7087 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:35:24.001996 7087 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:35:24.004956 7087 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14295e2168424d6eaf5910e417d5cb62" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36531 } }
I20260808 23:35:24.005604 7087 leader_election.cc:302] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14295e2168424d6eaf5910e417d5cb62; no voters:
I20260808 23:35:24.006345 7087 leader_election.cc:288] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:35:24.006496 7092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:35:24.007309 7092 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [term 1 LEADER]: Becoming Leader. State: Replica: 14295e2168424d6eaf5910e417d5cb62, State: Running, Role: LEADER
I20260808 23:35:24.008001 7092 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14295e2168424d6eaf5910e417d5cb62" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36531 } }
I20260808 23:35:24.009238 7087 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:35:24.011592 7093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "14295e2168424d6eaf5910e417d5cb62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14295e2168424d6eaf5910e417d5cb62" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36531 } } }
I20260808 23:35:24.012171 7093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [sys.catalog]: This master's current role is: LEADER
I20260808 23:35:24.011619 7094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14295e2168424d6eaf5910e417d5cb62. Latest consensus state: current_term: 1 leader_uuid: "14295e2168424d6eaf5910e417d5cb62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14295e2168424d6eaf5910e417d5cb62" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36531 } } }
I20260808 23:35:24.013119 7094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62 [sys.catalog]: This master's current role is: LEADER
I20260808 23:35:24.014487 7099 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:35:24.020146 7099 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:35:24.021451 7087 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 23:35:24.042482 7099 catalog_manager.cc:1347] Generated new cluster ID: 886f45abec024fe5b7472291115335f1
I20260808 23:35:24.042727 7099 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:35:24.069311 7099 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:35:24.071031 7099 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:35:24.080533 7099 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62: Generated new TSK 0
I20260808 23:35:24.081985 7099 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:35:24.878669 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.207.212:39741/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36531
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 23:35:25 dist-test-slave-1x4g krb5kdc[6511](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786232125, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 23:35:25.357636 7134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:35:25.358096 7134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:35:25.358281 7134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:35:25.370735 7134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:35:25.370932 7134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:35:25.371155 7134 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:35:25.388532 7134 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.207.212:39741/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36531
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:35:25.390777 7134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:35:25.392951 7134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:35:25.417212 7147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:35:25.417224 7146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:35:25.435271 7149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:35:25.436923 7134 server_base.cc:1034] running on GCE node
I20260808 23:35:25.438300 7134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:35:25.439577 7134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:35:25.440900 7134 hybrid_clock.cc:648] HybridClock initialized: now 1786232125440829 us; error 79 us; skew 500 ppm
I20260808 23:35:25.441301 7134 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:35:25 dist-test-slave-1x4g krb5kdc[6511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232125, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:35:25.445083 7134 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:35:25.453248 7134 webserver.cc:460] Webserver started at http://127.26.207.193:44009/ using document root <none> and password file <none>
I20260808 23:35:25.454170 7134 fs_manager.cc:359] Metadata directory not provided
I20260808 23:35:25.454355 7134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:35:25.454738 7134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 23:35:25 dist-test-slave-1x4g krb5kdc[6511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232125, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:35:25.481771 7134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "8c334700b9f74096bac7ddf2eb59863a"
format_stamp: "Formatted at 2026-08-08 23:35:25 on dist-test-slave-1x4g"
server_key: "68cfa562b347dfd26db87181255d3923"
server_key_iv: "dca39f0aeceaab15a70259fd8660f253"
server_key_version: "kuduclusterkey@0"
I20260808 23:35:25.483268 7134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "8c334700b9f74096bac7ddf2eb59863a"
format_stamp: "Formatted at 2026-08-08 23:35:25 on dist-test-slave-1x4g"
server_key: "68cfa562b347dfd26db87181255d3923"
server_key_iv: "dca39f0aeceaab15a70259fd8660f253"
server_key_version: "kuduclusterkey@0"
I20260808 23:35:25.499387 7134 fs_manager.cc:691] Time spent creating directory manager: real 0.015s user 0.002s sys 0.011s
I20260808 23:35:25.536090 7159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:35:25.538645 7134 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.003s sys 0.006s
I20260808 23:35:25.538933 7134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "8c334700b9f74096bac7ddf2eb59863a"
format_stamp: "Formatted at 2026-08-08 23:35:25 on dist-test-slave-1x4g"
server_key: "68cfa562b347dfd26db87181255d3923"
server_key_iv: "dca39f0aeceaab15a70259fd8660f253"
server_key_version: "kuduclusterkey@0"
I20260808 23:35:25.539286 7134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:35:25.563337 7134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:35:25.570838 7134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:35:25.571599 7134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:35:25.579798 7134 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:35:25.587955 7134 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:35:25.588249 7134 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 23:35:25.588596 7134 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:35:25.588886 7134 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 23:35:25 dist-test-slave-1x4g krb5kdc[6511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232125, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:35:26.110324 7134 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:42545
I20260808 23:35:26.110383 7281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:42545 every 8 connection(s)
I20260808 23:35:26.113201 7134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:35:26.121726 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 7134
I20260808 23:35:26.121966 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:35:26.122937 27455 external_mini_cluster.cc:1428] Setting key 42e58f48996df5f847925bab0f771309
Aug 08 23:35:26 dist-test-slave-1x4g krb5kdc[6511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232125, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:35:26.188616 7285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:26.117229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:55429 (local address 127.26.207.254:36531)
0808 23:35:26.161595 (+ 44366us) server_negotiation.cc:206] Beginning negotiation
0808 23:35:26.161602 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:35:26.161638 (+ 36us) server_negotiation.cc:407] Connection header received
0808 23:35:26.165882 (+ 4244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:35:26.165889 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:35:26.166022 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:35:26.166151 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:35:26.169070 (+ 2919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:26.170310 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:26.173144 (+ 2834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:26.173867 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:26.173989 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:26.179661 (+ 5672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:35:26.179670 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:35:26.179675 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:35:26.179748 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:35:26.183971 (+ 4223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:35:26.185326 (+ 1355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:35:26.185333 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:35:26.185337 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:35:26.185524 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:35:26.186163 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:35:26.186169 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:35:26.186173 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:35:26.186630 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:35:26.186772 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 23:35:26.187911 (+ 1139us) server_negotiation.cc:299] Negotiation successful
0808 23:35:26.188207 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43960,"thread_start_us":44466,"threads_started":1}
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
I20260808 23:35:26.191229 7287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:26.118584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36531 (local address 127.26.207.193:55429)
0808 23:35:26.153345 (+ 34761us) negotiation.cc:107] Waiting for socket to connect
0808 23:35:26.153432 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0808 23:35:26.165381 (+ 11949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:35:26.166740 (+ 1359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:35:26.166754 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:35:26.167678 (+ 924us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:35:26.168759 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:35:26.168823 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:35:26.170584 (+ 1761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:35:26.170589 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:35:26.172887 (+ 2298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:35:26.172910 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:35:26.174557 (+ 1647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:35:26.174566 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:35:26.174896 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:26.175902 (+ 1006us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:35:26.175938 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:35:26.179263 (+ 3325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:35:26.184269 (+ 5006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:35:26.184285 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:35:26.184312 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:35:26.185138 (+ 826us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:35:26.185698 (+ 560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:35:26.185703 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:35:26.185707 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:35:26.186015 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:35:26.186880 (+ 865us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:35:26.186889 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:35:26.187425 (+ 536us) client_negotiation.cc:769] Sending connection context
0808 23:35:26.189073 (+ 1648us) client_negotiation.cc:240] Negotiation successful
0808 23:35:26.189720 (+ 647us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34251,"thread_start_us":38094,"threads_started":1}
I20260808 23:35:26.193686 7283 heartbeater.cc:347] Connected to a master server at 127.26.207.254:36531
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
I20260808 23:35:26.194185 7283 heartbeater.cc:464] Registering TS with master...
I20260808 23:35:26.195351 7283 heartbeater.cc:511] Master 127.26.207.254:36531 requested a full tablet report, sending...
I20260808 23:35:26.202979 7043 ts_manager.cc:194] Registered new tserver with Master: 8c334700b9f74096bac7ddf2eb59863a (127.26.207.193:42545)
I20260808 23:35:26.205384 7043 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:55429
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
W20260808 23:35:26.243554 27455 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.26.207.194: real 0.117s user 0.000s sys 0.028s
I20260808 23:35:26.244858 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.207.212:39741/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36531
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 23:35:26 dist-test-slave-1x4g krb5kdc[6511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232125, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
W20260808 23:35:26.832203 7290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:35:26.832623 7290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:35:26.832883 7290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:35:26.844247 7290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:35:26.844461 7290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:35:26.844756 7290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:35:26.857712 7290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.207.212:39741/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36531
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:35:26.859396 7290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:35:26.860984 7290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:35:26.879006 7305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:35:26.879493 7306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:35:26.879932 7309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:35:26.881434 7290 server_base.cc:1034] running on GCE node
I20260808 23:35:26.882241 7290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:35:26.883548 7290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:35:26.885025 7290 hybrid_clock.cc:648] HybridClock initialized: now 1786232126884942 us; error 66 us; skew 500 ppm
I20260808 23:35:26.885514 7290 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:35:26 dist-test-slave-1x4g krb5kdc[6511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232126, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:35:26.889973 7290 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:35:26.892026 7290 webserver.cc:460] Webserver started at http://127.26.207.194:40993/ using document root <none> and password file <none>
I20260808 23:35:26.893082 7290 fs_manager.cc:359] Metadata directory not provided
I20260808 23:35:26.893301 7290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:35:26.893702 7290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 23:35:26 dist-test-slave-1x4g krb5kdc[6511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232126, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:35:26.911705 7290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "4b99ea57838b48c0a2eadcfdd938e7e4"
format_stamp: "Formatted at 2026-08-08 23:35:26 on dist-test-slave-1x4g"
server_key: "0b3005b9ddf30b3cf2711bd4db50812a"
server_key_iv: "d29a5ecb3dcbedfd1549a6dc8feaa828"
server_key_version: "kuduclusterkey@0"
I20260808 23:35:26.912866 7290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "4b99ea57838b48c0a2eadcfdd938e7e4"
format_stamp: "Formatted at 2026-08-08 23:35:26 on dist-test-slave-1x4g"
server_key: "0b3005b9ddf30b3cf2711bd4db50812a"
server_key_iv: "d29a5ecb3dcbedfd1549a6dc8feaa828"
server_key_version: "kuduclusterkey@0"
I20260808 23:35:26.920850 7290 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260808 23:35:26.940176 7316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:35:26.942062 7290 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260808 23:35:26.942340 7290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "4b99ea57838b48c0a2eadcfdd938e7e4"
format_stamp: "Formatted at 2026-08-08 23:35:26 on dist-test-slave-1x4g"
server_key: "0b3005b9ddf30b3cf2711bd4db50812a"
server_key_iv: "d29a5ecb3dcbedfd1549a6dc8feaa828"
server_key_version: "kuduclusterkey@0"
I20260808 23:35:26.942600 7290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:35:26.963141 7290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:35:26.968289 7290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:35:26.968683 7290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:35:26.970366 7290 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:35:26.972337 7290 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:35:26.972476 7290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:35:26.972648 7290 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:35:26.972728 7290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:35:27.025652 7290 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:36727
I20260808 23:35:27.025803 7442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:36727 every 8 connection(s)
I20260808 23:35:27.027143 7290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:35:27.036748 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 7290
I20260808 23:35:27.037034 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:35:27.037559 27455 external_mini_cluster.cc:1428] Setting key 211a2f93f7d92116d85b31fef17aab00
Aug 08 23:35:27 dist-test-slave-1x4g krb5kdc[6511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232126, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:35:27.059564 7446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:27.030860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:46091 (local address 127.26.207.254:36531)
0808 23:35:27.031475 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0808 23:35:27.031482 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:35:27.032805 (+ 1323us) server_negotiation.cc:407] Connection header received
0808 23:35:27.035796 (+ 2991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:35:27.035801 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:35:27.035890 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:35:27.036034 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:35:27.038508 (+ 2474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.039551 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.042557 (+ 3006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.043466 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.043633 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:27.049782 (+ 6149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:35:27.049791 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:35:27.049797 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:35:27.049851 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:35:27.054395 (+ 4544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:35:27.055745 (+ 1350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:35:27.055751 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:35:27.055755 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:35:27.056027 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:35:27.056702 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:35:27.056708 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:35:27.056711 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:35:27.057446 (+ 735us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:35:27.057646 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 23:35:27.058805 (+ 1159us) server_negotiation.cc:299] Negotiation successful
0808 23:35:27.059111 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":322,"threads_started":1}
I20260808 23:35:27.060983 7447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:27.031444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36531 (local address 127.26.207.194:46091)
0808 23:35:27.032508 (+ 1064us) negotiation.cc:107] Waiting for socket to connect
0808 23:35:27.032576 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0808 23:35:27.035318 (+ 2742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:35:27.036499 (+ 1181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:35:27.036514 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:35:27.037304 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:35:27.038286 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:35:27.038319 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.039838 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.039845 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:35:27.042249 (+ 2404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:35:27.042294 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.043780 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.043789 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:35:27.044118 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:27.045092 (+ 974us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:35:27.045146 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:35:27.049387 (+ 4241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:35:27.054655 (+ 5268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:35:27.054668 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:35:27.054692 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:35:27.055549 (+ 857us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:35:27.056194 (+ 645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:35:27.056202 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:35:27.056209 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:35:27.056535 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:35:27.057658 (+ 1123us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:35:27.057671 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:35:27.058264 (+ 593us) client_negotiation.cc:769] Sending connection context
0808 23:35:27.058636 (+ 372us) client_negotiation.cc:240] Negotiation successful
0808 23:35:27.059325 (+ 689us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":390,"threads_started":1}
I20260808 23:35:27.063158 7443 heartbeater.cc:347] Connected to a master server at 127.26.207.254:36531
I20260808 23:35:27.063570 7443 heartbeater.cc:464] Registering TS with master...
I20260808 23:35:27.064570 7443 heartbeater.cc:511] Master 127.26.207.254:36531 requested a full tablet report, sending...
I20260808 23:35:27.066634 7043 ts_manager.cc:194] Registered new tserver with Master: 4b99ea57838b48c0a2eadcfdd938e7e4 (127.26.207.194:36727)
I20260808 23:35:27.067991 7043 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:46091
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:35:27.117169 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.207.212:39741/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36531
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:35:27.210242 7283 heartbeater.cc:503] Master 127.26.207.254:36531 was elected leader, sending a full tablet report...
W20260808 23:35:27.603770 7451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:35:27.604115 7451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:35:27.604247 7451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:35:27.613221 7451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:35:27.613363 7451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:35:27.613494 7451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:35:27.624806 7451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.207.212:39741/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:36531
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:35:27.626317 7451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:35:27.627727 7451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:35:27.645395 7457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:35:27.645395 7456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:35:27.646145 7459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:35:27.647178 7451 server_base.cc:1034] running on GCE node
I20260808 23:35:27.648138 7451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:35:27.649346 7451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:35:27.650614 7451 hybrid_clock.cc:648] HybridClock initialized: now 1786232127650559 us; error 39 us; skew 500 ppm
I20260808 23:35:27.651005 7451 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:35:27 dist-test-slave-1x4g krb5kdc[6511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232127, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:35:27.656468 7451 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:35:27.658766 7451 webserver.cc:460] Webserver started at http://127.26.207.195:44399/ using document root <none> and password file <none>
I20260808 23:35:27.659711 7451 fs_manager.cc:359] Metadata directory not provided
I20260808 23:35:27.659932 7451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:35:27.660354 7451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 23:35:27 dist-test-slave-1x4g krb5kdc[6511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232127, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:35:27.677577 7451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "944b282d8d09432fb1fe594f7655d4bb"
format_stamp: "Formatted at 2026-08-08 23:35:27 on dist-test-slave-1x4g"
server_key: "30ebff389c238865ba687553faf2fafe"
server_key_iv: "12cc2c9c8503b08099248c9c65bcd99b"
server_key_version: "kuduclusterkey@0"
I20260808 23:35:27.678879 7451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "944b282d8d09432fb1fe594f7655d4bb"
format_stamp: "Formatted at 2026-08-08 23:35:27 on dist-test-slave-1x4g"
server_key: "30ebff389c238865ba687553faf2fafe"
server_key_iv: "12cc2c9c8503b08099248c9c65bcd99b"
server_key_version: "kuduclusterkey@0"
I20260808 23:35:27.686851 7451 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260808 23:35:27.705263 7468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:35:27.706993 7451 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 23:35:27.707255 7451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "944b282d8d09432fb1fe594f7655d4bb"
format_stamp: "Formatted at 2026-08-08 23:35:27 on dist-test-slave-1x4g"
server_key: "30ebff389c238865ba687553faf2fafe"
server_key_iv: "12cc2c9c8503b08099248c9c65bcd99b"
server_key_version: "kuduclusterkey@0"
I20260808 23:35:27.707540 7451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:35:27.733004 7451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:35:27.737874 7451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:35:27.738312 7451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:35:27.739580 7451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:35:27.741336 7451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:35:27.741463 7451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:35:27.741627 7451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:35:27.741704 7451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:35:27.796523 7451 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:34359
I20260808 23:35:27.796561 7595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:34359 every 8 connection(s)
I20260808 23:35:27.798077 7451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:35:27.805306 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 7451
I20260808 23:35:27.805511 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:35:27.805984 27455 external_mini_cluster.cc:1428] Setting key 1ac1d512b609a24f90425f79d0d8d0d4
Aug 08 23:35:27 dist-test-slave-1x4g krb5kdc[6511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232127, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:35:27.823210 7598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:27.800899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:39507 (local address 127.26.207.254:36531)
0808 23:35:27.801622 (+ 723us) server_negotiation.cc:206] Beginning negotiation
0808 23:35:27.801627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:35:27.802436 (+ 809us) server_negotiation.cc:407] Connection header received
0808 23:35:27.804487 (+ 2051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:35:27.804493 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:35:27.804616 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:35:27.804748 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:35:27.806743 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.807898 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.810359 (+ 2461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.810934 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.811176 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:27.815689 (+ 4513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:35:27.815696 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:35:27.815699 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:35:27.815742 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:35:27.818936 (+ 3194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:35:27.820029 (+ 1093us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:35:27.820037 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:35:27.820041 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:35:27.820278 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:35:27.820988 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:35:27.820993 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:35:27.820997 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:35:27.821315 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:35:27.821496 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 23:35:27.822515 (+ 1019us) server_negotiation.cc:299] Negotiation successful
0808 23:35:27.822828 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":433,"threads_started":1}
I20260808 23:35:27.824306 7599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:27.801445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:36531 (local address 127.26.207.195:39507)
0808 23:35:27.802237 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0808 23:35:27.802289 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 23:35:27.804147 (+ 1858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:35:27.805073 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:35:27.805082 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:35:27.805741 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:35:27.806475 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:35:27.806520 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.808107 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.808113 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:35:27.810184 (+ 2071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:35:27.810209 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.811356 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.811367 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:35:27.811757 (+ 390us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:27.812563 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:35:27.812600 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:35:27.815288 (+ 2688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:35:27.819158 (+ 3870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:35:27.819169 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:35:27.819187 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:35:27.819793 (+ 606us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:35:27.820450 (+ 657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:35:27.820456 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:35:27.820459 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:35:27.820831 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:35:27.821469 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:35:27.821479 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:35:27.822008 (+ 529us) client_negotiation.cc:769] Sending connection context
0808 23:35:27.822360 (+ 352us) client_negotiation.cc:240] Negotiation successful
0808 23:35:27.822976 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":321,"threads_started":1}
I20260808 23:35:27.826229 7596 heartbeater.cc:347] Connected to a master server at 127.26.207.254:36531
I20260808 23:35:27.826629 7596 heartbeater.cc:464] Registering TS with master...
I20260808 23:35:27.827641 7596 heartbeater.cc:511] Master 127.26.207.254:36531 requested a full tablet report, sending...
I20260808 23:35:27.829483 7043 ts_manager.cc:194] Registered new tserver with Master: 944b282d8d09432fb1fe594f7655d4bb (127.26.207.195:34359)
I20260808 23:35:27.830474 7043 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:39507
I20260808 23:35:27.835971 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:35:27.856074 7598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:27.841578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42086 (local address 127.26.207.254:36531)
0808 23:35:27.841772 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 23:35:27.841777 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:35:27.842355 (+ 578us) server_negotiation.cc:407] Connection header received
0808 23:35:27.842528 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:35:27.842532 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:35:27.842624 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:35:27.842724 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:35:27.844323 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.845221 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.846755 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.847228 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.847431 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:27.850349 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:35:27.850355 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:35:27.850358 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:35:27.850400 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:35:27.853348 (+ 2948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:35:27.854113 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:35:27.854117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:35:27.854119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:35:27.854254 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:35:27.854612 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:35:27.854616 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:35:27.854618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:35:27.854920 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:35:27.855121 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 23:35:27.855417 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 23:35:27.855684 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 23:35:27.860838 7043 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42086:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:35:27.869058 7043 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:35:27.913443 7619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:27.900348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58482 (local address 127.26.207.194:36727)
0808 23:35:27.902554 (+ 2206us) server_negotiation.cc:206] Beginning negotiation
0808 23:35:27.902565 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 23:35:27.903651 (+ 1086us) server_negotiation.cc:407] Connection header received
0808 23:35:27.903777 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:35:27.903784 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:35:27.904014 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:35:27.904627 (+ 613us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:35:27.905154 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.906739 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.910456 (+ 3717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.911731 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.912319 (+ 588us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:27.912491 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 23:35:27.912606 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 23:35:27.912819 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2018,"thread_start_us":1874,"threads_started":1}
I20260808 23:35:27.913587 7616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:27.884512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38100 (local address 127.26.207.195:34359)
0808 23:35:27.899008 (+ 14496us) server_negotiation.cc:206] Beginning negotiation
0808 23:35:27.899021 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:35:27.899072 (+ 51us) server_negotiation.cc:407] Connection header received
0808 23:35:27.899214 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:35:27.899226 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:35:27.899618 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:35:27.902005 (+ 2387us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:35:27.903552 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.905644 (+ 2092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.909594 (+ 3950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.911634 (+ 2040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.911966 (+ 332us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:27.912240 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0808 23:35:27.912741 (+ 501us) server_negotiation.cc:299] Negotiation successful
0808 23:35:27.913001 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14251,"thread_start_us":13985,"threads_started":1}
I20260808 23:35:27.913537 7615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:27.884032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:34359 (local address 127.0.0.1:38100)
0808 23:35:27.898105 (+ 14073us) negotiation.cc:107] Waiting for socket to connect
0808 23:35:27.898184 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0808 23:35:27.898472 (+ 288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:35:27.902505 (+ 4033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:35:27.902515 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:35:27.902556 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:35:27.903285 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:35:27.903303 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.905846 (+ 2543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.905851 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:35:27.909280 (+ 3429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:35:27.909296 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.912017 (+ 2721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.912025 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:35:27.912305 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:27.912364 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 23:35:27.912552 (+ 188us) client_negotiation.cc:240] Negotiation successful
0808 23:35:27.912948 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13755,"mutex_wait_us":7,"thread_start_us":17429,"threads_started":1}
I20260808 23:35:27.914067 7614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:27.884110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:42545 (local address 127.0.0.1:42108)
0808 23:35:27.901862 (+ 17752us) negotiation.cc:107] Waiting for socket to connect
0808 23:35:27.901891 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 23:35:27.902615 (+ 724us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:35:27.904030 (+ 1415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:35:27.904034 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:35:27.904064 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:35:27.904739 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:35:27.904756 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.907541 (+ 2785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.907546 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:35:27.910498 (+ 2952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:35:27.910511 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.912955 (+ 2444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.912963 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:35:27.913190 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:27.913230 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 23:35:27.913307 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 23:35:27.913508 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17559,"mutex_wait_us":7,"spinlock_wait_cycles":1792,"thread_start_us":14696,"threads_started":1}
I20260808 23:35:27.914510 7618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:27.900002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:36727 (local address 127.0.0.1:58482)
0808 23:35:27.903380 (+ 3378us) negotiation.cc:107] Waiting for socket to connect
0808 23:35:27.903399 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:35:27.903519 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:35:27.904253 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:35:27.904258 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:35:27.904288 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:35:27.904946 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:35:27.904986 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.906945 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.906951 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:35:27.910165 (+ 3214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:35:27.910183 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.912068 (+ 1885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.912074 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:35:27.912380 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:27.912419 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 23:35:27.912532 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 23:35:27.913881 (+ 1349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3224,"mutex_wait_us":1197,"thread_start_us":3007,"threads_started":1}
I20260808 23:35:27.914980 7617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:27.884837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42108 (local address 127.26.207.193:42545)
0808 23:35:27.900982 (+ 16145us) server_negotiation.cc:206] Beginning negotiation
0808 23:35:27.900996 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:35:27.903289 (+ 2293us) server_negotiation.cc:407] Connection header received
0808 23:35:27.903438 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:35:27.903460 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:35:27.903776 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:35:27.904021 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:35:27.905075 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.907379 (+ 2304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.910717 (+ 3338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.912606 (+ 1889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.914073 (+ 1467us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:27.914277 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 23:35:27.914399 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 23:35:27.914626 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15833,"thread_start_us":16150,"threads_started":1}
I20260808 23:35:27.919317 7369 tablet_service.cc:1467] Processing CreateTablet for tablet 9b7c51767ed241a59b32cdcac89a089e (DEFAULT_TABLE table=test-table [id=672273043f6f43a3985b50ba3b92abb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:35:27.919418 7522 tablet_service.cc:1467] Processing CreateTablet for tablet 9b7c51767ed241a59b32cdcac89a089e (DEFAULT_TABLE table=test-table [id=672273043f6f43a3985b50ba3b92abb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:35:27.919437 7212 tablet_service.cc:1467] Processing CreateTablet for tablet 9b7c51767ed241a59b32cdcac89a089e (DEFAULT_TABLE table=test-table [id=672273043f6f43a3985b50ba3b92abb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:35:27.920845 7369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b7c51767ed241a59b32cdcac89a089e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:35:27.921213 7522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b7c51767ed241a59b32cdcac89a089e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:35:27.921227 7212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b7c51767ed241a59b32cdcac89a089e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:35:27.936237 7620 tablet_bootstrap.cc:492] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4: Bootstrap starting.
I20260808 23:35:27.940414 7621 tablet_bootstrap.cc:492] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb: Bootstrap starting.
I20260808 23:35:27.941498 7622 tablet_bootstrap.cc:492] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a: Bootstrap starting.
I20260808 23:35:27.943540 7620 tablet_bootstrap.cc:654] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4: Neither blocks nor log segments found. Creating new log.
I20260808 23:35:27.945703 7620 log.cc:824] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4: Log is configured to *not* fsync() on all Append() calls
I20260808 23:35:27.947228 7621 tablet_bootstrap.cc:654] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb: Neither blocks nor log segments found. Creating new log.
I20260808 23:35:27.948683 7622 tablet_bootstrap.cc:654] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a: Neither blocks nor log segments found. Creating new log.
I20260808 23:35:27.948948 7621 log.cc:824] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb: Log is configured to *not* fsync() on all Append() calls
I20260808 23:35:27.950765 7620 tablet_bootstrap.cc:492] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4: No bootstrap required, opened a new log
I20260808 23:35:27.950556 7622 log.cc:824] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a: Log is configured to *not* fsync() on all Append() calls
I20260808 23:35:27.951203 7620 ts_tablet_manager.cc:1397] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.009s
I20260808 23:35:27.953819 7621 tablet_bootstrap.cc:492] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb: No bootstrap required, opened a new log
I20260808 23:35:27.954237 7621 ts_tablet_manager.cc:1397] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260808 23:35:27.955909 7622 tablet_bootstrap.cc:492] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a: No bootstrap required, opened a new log
I20260808 23:35:27.956233 7622 ts_tablet_manager.cc:1397] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.005s
I20260808 23:35:27.964345 7620 raft_consensus.cc:348] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b282d8d09432fb1fe594f7655d4bb" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34359 } } peers { permanent_uuid: "8c334700b9f74096bac7ddf2eb59863a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42545 } } peers { permanent_uuid: "4b99ea57838b48c0a2eadcfdd938e7e4" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36727 } }
I20260808 23:35:27.965229 7620 raft_consensus.cc:374] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:35:27.965508 7620 raft_consensus.cc:729] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b99ea57838b48c0a2eadcfdd938e7e4, State: Initialized, Role: FOLLOWER
I20260808 23:35:27.967152 7622 raft_consensus.cc:348] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b282d8d09432fb1fe594f7655d4bb" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34359 } } peers { permanent_uuid: "8c334700b9f74096bac7ddf2eb59863a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42545 } } peers { permanent_uuid: "4b99ea57838b48c0a2eadcfdd938e7e4" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36727 } }
I20260808 23:35:27.967374 7621 raft_consensus.cc:348] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b282d8d09432fb1fe594f7655d4bb" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34359 } } peers { permanent_uuid: "8c334700b9f74096bac7ddf2eb59863a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42545 } } peers { permanent_uuid: "4b99ea57838b48c0a2eadcfdd938e7e4" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36727 } }
I20260808 23:35:27.967788 7622 raft_consensus.cc:374] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:35:27.967969 7622 raft_consensus.cc:729] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c334700b9f74096bac7ddf2eb59863a, State: Initialized, Role: FOLLOWER
I20260808 23:35:27.968044 7621 raft_consensus.cc:374] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:35:27.968230 7621 raft_consensus.cc:729] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 944b282d8d09432fb1fe594f7655d4bb, State: Initialized, Role: FOLLOWER
I20260808 23:35:27.968611 7620 consensus_queue.cc:260] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b282d8d09432fb1fe594f7655d4bb" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34359 } } peers { permanent_uuid: "8c334700b9f74096bac7ddf2eb59863a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42545 } } peers { permanent_uuid: "4b99ea57838b48c0a2eadcfdd938e7e4" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36727 } }
I20260808 23:35:27.968993 7622 consensus_queue.cc:260] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b282d8d09432fb1fe594f7655d4bb" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34359 } } peers { permanent_uuid: "8c334700b9f74096bac7ddf2eb59863a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42545 } } peers { permanent_uuid: "4b99ea57838b48c0a2eadcfdd938e7e4" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36727 } }
I20260808 23:35:27.969326 7621 consensus_queue.cc:260] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b282d8d09432fb1fe594f7655d4bb" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34359 } } peers { permanent_uuid: "8c334700b9f74096bac7ddf2eb59863a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42545 } } peers { permanent_uuid: "4b99ea57838b48c0a2eadcfdd938e7e4" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36727 } }
I20260808 23:35:27.975780 7621 ts_tablet_manager.cc:1428] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb: Time spent starting tablet: real 0.021s user 0.011s sys 0.008s
I20260808 23:35:27.976394 7596 heartbeater.cc:503] Master 127.26.207.254:36531 was elected leader, sending a full tablet report...
I20260808 23:35:27.976500 7443 heartbeater.cc:503] Master 127.26.207.254:36531 was elected leader, sending a full tablet report...
I20260808 23:35:27.977788 7620 ts_tablet_manager.cc:1428] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4: Time spent starting tablet: real 0.026s user 0.018s sys 0.004s
I20260808 23:35:27.980089 7622 ts_tablet_manager.cc:1428] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a: Time spent starting tablet: real 0.024s user 0.017s sys 0.005s
I20260808 23:35:27.991118 7627 raft_consensus.cc:482] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:35:27.991423 7627 raft_consensus.cc:504] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b282d8d09432fb1fe594f7655d4bb" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34359 } } peers { permanent_uuid: "8c334700b9f74096bac7ddf2eb59863a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42545 } } peers { permanent_uuid: "4b99ea57838b48c0a2eadcfdd938e7e4" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36727 } }
I20260808 23:35:27.993358 7627 leader_election.cc:288] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 944b282d8d09432fb1fe594f7655d4bb (127.26.207.195:34359), 4b99ea57838b48c0a2eadcfdd938e7e4 (127.26.207.194:36727)
I20260808 23:35:28.005268 7619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:27.994108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:57639 (local address 127.26.207.194:36727)
0808 23:35:27.994353 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 23:35:27.994362 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:35:27.995334 (+ 972us) server_negotiation.cc:407] Connection header received
0808 23:35:27.995455 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:35:27.995460 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:35:27.995592 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:35:27.995687 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:35:27.997230 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.998660 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:28.002459 (+ 3799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:28.003998 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:28.004182 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:28.004263 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 23:35:28.004771 (+ 508us) server_negotiation.cc:299] Negotiation successful
0808 23:35:28.004941 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 23:35:28.005276 7616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:27.994155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:35117 (local address 127.26.207.195:34359)
0808 23:35:27.994422 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 23:35:27.994448 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 23:35:27.995222 (+ 774us) server_negotiation.cc:407] Connection header received
0808 23:35:27.995442 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:35:27.995448 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:35:27.995551 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:35:27.995677 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:35:27.997260 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.998612 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:28.002439 (+ 3827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:28.003969 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:28.004199 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:28.004266 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 23:35:28.004771 (+ 505us) server_negotiation.cc:299] Negotiation successful
0808 23:35:28.004941 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 23:35:28.005656 7632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:27.994164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:36727 (local address 127.26.207.193:57639)
0808 23:35:27.995223 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0808 23:35:27.995240 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 23:35:27.995350 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:35:27.995721 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:35:27.995726 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:35:27.995771 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:35:27.996950 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:35:27.996977 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.998830 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.998836 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:35:28.002204 (+ 3368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:35:28.002226 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:35:28.004312 (+ 2086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:35:28.004321 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:35:28.004554 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:28.004612 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 23:35:28.004726 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 23:35:28.004931 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":933,"mutex_wait_us":258,"spinlock_wait_cycles":8832,"thread_start_us":713,"threads_started":1}
I20260808 23:35:28.005707 7631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:27.993622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:34359 (local address 127.26.207.193:35117)
0808 23:35:27.995073 (+ 1451us) negotiation.cc:107] Waiting for socket to connect
0808 23:35:27.995101 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 23:35:27.995285 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:35:27.995721 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:35:27.995726 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:35:27.995765 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:35:27.997111 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:35:27.997125 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:35:27.998830 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:35:27.998836 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:35:28.002207 (+ 3371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:35:28.002226 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:35:28.004331 (+ 2105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:35:28.004337 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:35:28.004569 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:28.004624 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 23:35:28.004726 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 23:35:28.004931 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1256,"mutex_wait_us":324,"spinlock_wait_cycles":1280,"thread_start_us":898,"threads_started":1}
I20260808 23:35:28.007009 7390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b7c51767ed241a59b32cdcac89a089e" candidate_uuid: "8c334700b9f74096bac7ddf2eb59863a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b99ea57838b48c0a2eadcfdd938e7e4" is_pre_election: true
I20260808 23:35:28.007100 7544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b7c51767ed241a59b32cdcac89a089e" candidate_uuid: "8c334700b9f74096bac7ddf2eb59863a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "944b282d8d09432fb1fe594f7655d4bb" is_pre_election: true
I20260808 23:35:28.007604 7390 raft_consensus.cc:2454] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c334700b9f74096bac7ddf2eb59863a in term 0.
I20260808 23:35:28.007822 7544 raft_consensus.cc:2454] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c334700b9f74096bac7ddf2eb59863a in term 0.
I20260808 23:35:28.008672 7160 leader_election.cc:302] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4b99ea57838b48c0a2eadcfdd938e7e4, 8c334700b9f74096bac7ddf2eb59863a, 944b282d8d09432fb1fe594f7655d4bb; no voters:
I20260808 23:35:28.009351 7627 raft_consensus.cc:2781] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:35:28.009774 7627 raft_consensus.cc:482] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:35:28.009969 7627 raft_consensus.cc:3037] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:35:28.013513 7627 raft_consensus.cc:504] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b282d8d09432fb1fe594f7655d4bb" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34359 } } peers { permanent_uuid: "8c334700b9f74096bac7ddf2eb59863a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42545 } } peers { permanent_uuid: "4b99ea57838b48c0a2eadcfdd938e7e4" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36727 } }
I20260808 23:35:28.014268 7627 leader_election.cc:288] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [CANDIDATE]: Term 1 election: Requested vote from peers 944b282d8d09432fb1fe594f7655d4bb (127.26.207.195:34359), 4b99ea57838b48c0a2eadcfdd938e7e4 (127.26.207.194:36727)
I20260808 23:35:28.015131 7390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b7c51767ed241a59b32cdcac89a089e" candidate_uuid: "8c334700b9f74096bac7ddf2eb59863a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b99ea57838b48c0a2eadcfdd938e7e4"
I20260808 23:35:28.015131 7544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b7c51767ed241a59b32cdcac89a089e" candidate_uuid: "8c334700b9f74096bac7ddf2eb59863a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "944b282d8d09432fb1fe594f7655d4bb"
I20260808 23:35:28.015425 7390 raft_consensus.cc:3037] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:35:28.015427 7544 raft_consensus.cc:3037] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:35:28.019248 7544 raft_consensus.cc:2454] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c334700b9f74096bac7ddf2eb59863a in term 1.
I20260808 23:35:28.019304 7390 raft_consensus.cc:2454] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c334700b9f74096bac7ddf2eb59863a in term 1.
I20260808 23:35:28.019946 7160 leader_election.cc:302] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4b99ea57838b48c0a2eadcfdd938e7e4, 8c334700b9f74096bac7ddf2eb59863a, 944b282d8d09432fb1fe594f7655d4bb; no voters:
I20260808 23:35:28.020332 7627 raft_consensus.cc:2781] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:35:28.021039 7627 raft_consensus.cc:686] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [term 1 LEADER]: Becoming Leader. State: Replica: 8c334700b9f74096bac7ddf2eb59863a, State: Running, Role: LEADER
I20260808 23:35:28.021651 7627 consensus_queue.cc:237] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b282d8d09432fb1fe594f7655d4bb" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34359 } } peers { permanent_uuid: "8c334700b9f74096bac7ddf2eb59863a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42545 } } peers { permanent_uuid: "4b99ea57838b48c0a2eadcfdd938e7e4" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36727 } }
I20260808 23:35:28.027393 7042 catalog_manager.cc:5495] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c334700b9f74096bac7ddf2eb59863a (127.26.207.193). New cstate: current_term: 1 leader_uuid: "8c334700b9f74096bac7ddf2eb59863a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944b282d8d09432fb1fe594f7655d4bb" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c334700b9f74096bac7ddf2eb59863a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b99ea57838b48c0a2eadcfdd938e7e4" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36727 } health_report { overall_health: UNKNOWN } } }
W20260808 23:35:28.030081 7445 tablet.cc:2369] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:35:28.050143 7597 tablet.cc:2369] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:35:28.057451 7617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:28.051053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42120 (local address 127.26.207.193:42545)
0808 23:35:28.051266 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 23:35:28.051270 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:35:28.051423 (+ 153us) server_negotiation.cc:407] Connection header received
0808 23:35:28.051628 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:35:28.051632 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:35:28.051725 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:35:28.051852 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:35:28.052276 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:28.053174 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:28.054883 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:28.055311 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:28.055426 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:28.056083 (+ 657us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:35:28.056655 (+ 572us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:35:28.056880 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 23:35:28.057016 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 23:35:28.057131 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 23:35:28.067301 7390 raft_consensus.cc:1261] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4 [term 1 FOLLOWER]: Refusing update from remote peer 8c334700b9f74096bac7ddf2eb59863a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:35:28.067284 7544 raft_consensus.cc:1261] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb [term 1 FOLLOWER]: Refusing update from remote peer 8c334700b9f74096bac7ddf2eb59863a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:35:28.068502 7633 consensus_queue.cc:1035] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b99ea57838b48c0a2eadcfdd938e7e4" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:35:28.069072 7627 consensus_queue.cc:1035] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [LEADER]: Connected to new peer: Peer: permanent_uuid: "944b282d8d09432fb1fe594f7655d4bb" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:35:28.102053 7042 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:35:28.102483 7042 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:35:28.107085 7042 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 14295e2168424d6eaf5910e417d5cb62: Sending DeleteTablet for 3 replicas of tablet 9b7c51767ed241a59b32cdcac89a089e
I20260808 23:35:28.108641 7522 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b7c51767ed241a59b32cdcac89a089e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:35:28 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:38100
I20260808 23:35:28.108983 7369 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b7c51767ed241a59b32cdcac89a089e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:35:28 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:58482
I20260808 23:35:28.110381 7648 tablet_replica.cc:330] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4: stopping tablet replica
I20260808 23:35:28.110792 7647 tablet_replica.cc:330] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb: stopping tablet replica
I20260808 23:35:28.110962 7648 raft_consensus.cc:2229] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:35:28.111172 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 7134
I20260808 23:35:28.111349 7647 raft_consensus.cc:2229] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:35:28.111678 7648 raft_consensus.cc:2258] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:35:28.111865 7647 raft_consensus.cc:2258] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:35:28.112514 7212 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b7c51767ed241a59b32cdcac89a089e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:35:28 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:42108
I20260808 23:35:28.118067 7648 ts_tablet_manager.cc:1905] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:35:28.126398 7648 ts_tablet_manager.cc:1918] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:35:28.127334 7651 tablet_replica.cc:330] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a: stopping tablet replica
I20260808 23:35:28.128086 7651 raft_consensus.cc:2229] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:35:28.128130 7647 ts_tablet_manager.cc:1905] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 23:35:28 dist-test-slave-1x4g krb5kdc[6511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:35:28.129154 7651 raft_consensus.cc:2258] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:35:28.129508 7648 log.cc:1196] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/9b7c51767ed241a59b32cdcac89a089e
I20260808 23:35:28.130245 7648 ts_tablet_manager.cc:1939] T 9b7c51767ed241a59b32cdcac89a089e P 4b99ea57838b48c0a2eadcfdd938e7e4: Deleting consensus metadata
I20260808 23:35:28.133278 7651 ts_tablet_manager.cc:1905] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:35:28.133487 7028 catalog_manager.cc:4841] TS 4b99ea57838b48c0a2eadcfdd938e7e4 (127.26.207.194:36727): tablet 9b7c51767ed241a59b32cdcac89a089e (table test-table [id=672273043f6f43a3985b50ba3b92abb7]) successfully deleted
I20260808 23:35:28.140053 7617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:28.112609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42130 (local address 127.26.207.193:42545)
0808 23:35:28.112832 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 23:35:28.112839 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:35:28.116136 (+ 3297us) server_negotiation.cc:407] Connection header received
0808 23:35:28.116463 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:35:28.116469 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:35:28.116584 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:35:28.116687 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:35:28.118873 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:28.120183 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:28.122496 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:28.123289 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:28.123411 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:28.130415 (+ 7004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:35:28.130444 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:35:28.130464 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:35:28.130533 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:35:28.135237 (+ 4704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:35:28.136224 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:35:28.136234 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:35:28.136237 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:35:28.136517 (+ 280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:35:28.137271 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:35:28.137277 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:35:28.137280 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:35:28.137970 (+ 690us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:35:28.138369 (+ 399us) server_negotiation.cc:1035] Waiting for connection context
0808 23:35:28.139246 (+ 877us) server_negotiation.cc:299] Negotiation successful
0808 23:35:28.139591 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 23:35:28.142392 7277 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:35:28.142752 7647 ts_tablet_manager.cc:1918] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:35:28.143041 7647 log.cc:1196] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/9b7c51767ed241a59b32cdcac89a089e
I20260808 23:35:28.143968 7647 ts_tablet_manager.cc:1939] T 9b7c51767ed241a59b32cdcac89a089e P 944b282d8d09432fb1fe594f7655d4bb: Deleting consensus metadata
I20260808 23:35:28.146517 7027 catalog_manager.cc:4841] TS 944b282d8d09432fb1fe594f7655d4bb (127.26.207.195:34359): tablet 9b7c51767ed241a59b32cdcac89a089e (table test-table [id=672273043f6f43a3985b50ba3b92abb7]) successfully deleted
I20260808 23:35:28.245033 7651 ts_tablet_manager.cc:1918] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:35:28.245687 7651 log.cc:1196] T 9b7c51767ed241a59b32cdcac89a089e P 8c334700b9f74096bac7ddf2eb59863a: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/9b7c51767ed241a59b32cdcac89a089e
I20260808 23:35:28.245985 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 7134
I20260808 23:35:28.270797 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 7290
W20260808 23:35:28.270845 7028 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.207.193:42545 (error 108)
I20260808 23:35:28.272938 7618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:28.272422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:42545 (local address 127.0.0.1:42146)
0808 23:35:28.272615 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 23:35:28.272725 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:42545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 23:35:28.273201 7028 catalog_manager.cc:4584] TS 8c334700b9f74096bac7ddf2eb59863a (127.26.207.193:42545): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9b7c51767ed241a59b32cdcac89a089e: Network error: Client connection negotiation failed: client connection to 127.26.207.193:42545: connect: Connection refused (error 111)
Aug 08 23:35:28 dist-test-slave-1x4g krb5kdc[6511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:35:28.288137 7619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:28.271764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58484 (local address 127.26.207.194:36727)
0808 23:35:28.271945 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 23:35:28.271952 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:35:28.272036 (+ 84us) server_negotiation.cc:407] Connection header received
0808 23:35:28.272269 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:35:28.272275 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:35:28.272351 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:35:28.272465 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:35:28.274367 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:28.275289 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:28.276706 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:28.277383 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:28.277532 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:28.282254 (+ 4722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:35:28.282273 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:35:28.282290 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:35:28.282330 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:35:28.285383 (+ 3053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:35:28.286202 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:35:28.286210 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:35:28.286212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:35:28.286349 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:35:28.286694 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:35:28.286697 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:35:28.286699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:35:28.287070 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:35:28.287298 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 23:35:28.287536 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 23:35:28.287723 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 23:35:28.289121 7436 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:35:28.327096 7618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:28.326613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:42545 (local address 127.0.0.1:42152)
0808 23:35:28.326829 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 23:35:28.326921 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:42545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 23:35:28.328259 7618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:28.327885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:42545 (local address 127.0.0.1:42160)
0808 23:35:28.328048 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 23:35:28.328144 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:42545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 23:35:28.383302 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 7290
I20260808 23:35:28.388945 7618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:28.388250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:42545 (local address 127.0.0.1:42164)
0808 23:35:28.388593 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0808 23:35:28.388689 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:42545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174}
I20260808 23:35:28.390048 7618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:28.389670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:42545 (local address 127.0.0.1:42180)
0808 23:35:28.389837 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 23:35:28.389922 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:42545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 23:35:28.404875 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 7451
Aug 08 23:35:28 dist-test-slave-1x4g krb5kdc[6511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:35:28.428423 7616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:28.405869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38114 (local address 127.26.207.195:34359)
0808 23:35:28.406098 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 23:35:28.406104 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:35:28.406129 (+ 25us) server_negotiation.cc:407] Connection header received
0808 23:35:28.406339 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:35:28.406344 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:35:28.406427 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:35:28.406558 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:35:28.407992 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:28.409105 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:28.410703 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:35:28.411130 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:35:28.411280 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:35:28.421951 (+ 10671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:35:28.421972 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:35:28.421991 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:35:28.422041 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:35:28.425296 (+ 3255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:35:28.426212 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:35:28.426221 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:35:28.426224 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:35:28.426373 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:35:28.426776 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:35:28.426779 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:35:28.426781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:35:28.427205 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:35:28.427431 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 23:35:28.427739 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 23:35:28.427961 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 23:35:28.429291 7590 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:35:28.471218 7618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:28.470681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:42545 (local address 127.0.0.1:42192)
0808 23:35:28.470963 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 23:35:28.471058 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:42545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260808 23:35:28.472361 7618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:35:28.471949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:42545 (local address 127.0.0.1:42196)
0808 23:35:28.472153 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 23:35:28.472240 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:42545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260808 23:35:28.523988 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 7451
I20260808 23:35:28.546242 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 7011
I20260808 23:35:28.547639 7081 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:35:28.669268 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 7011
I20260808 23:35:28.702507 27455 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 23:35:29.049103 27455 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 23:35:29.049428 27455 mini_ranger.cc:66] Stopping Ranger...
I20260808 23:35:29.407153 27455 mini_ranger.cc:68] Stopped Ranger
2026-08-08 23:35:29.407 UTC [6546] LOG: received smart shutdown request
2026-08-08 23:35:29.413 UTC [6546] LOG: background worker "logical replication launcher" (PID 6554) exited with exit code 1
2026-08-08 23:35:29.414 UTC [6549] LOG: shutting down
2026-08-08 23:35:29.587 UTC [6546] LOG: database system is shut down
2026-08-08T23:35:29Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (56328 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:35:29 dist-test-slave-1x4g krb5kdc[7667](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:35:29 dist-test-slave-1x4g krb5kdc[7667](info): set up 2 sockets
Aug 08 23:35:29 dist-test-slave-1x4g krb5kdc[7667](info): commencing operation
krb5kdc: starting...
W20260808 23:35:30.917188 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:35:31 dist-test-slave-1x4g krb5kdc[7667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:35:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:35:31Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.207.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.207.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.207.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/rangeradmin_127.26.207.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.207.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/rangeradmin_127.26.207.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.207.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.207.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.207.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/rangerlookup_127.26.207.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.207.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/rangerlookup_127.26.207.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.207.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.207.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.207.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/HTTP_127.26.207.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.207.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/HTTP_127.26.207.212@KRBTEST.COM.keytab.
I20260808 23:35:31.376863 27455 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskWgS6PY/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/postgres -l logfile start
2026-08-08 23:35:34.219 UTC [7699] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 23:35:34.219 UTC [7699] LOG: listening on IPv4 address "127.26.207.212", port 51719
2026-08-08 23:35:34.223 UTC [7699] LOG: listening on Unix socket "/tmp/.s.PGSQL.51719"
2026-08-08 23:35:34.250 UTC [7701] LOG: database system was shut down at 2026-08-08 23:35:32 UTC
2026-08-08 23:35:34.254 UTC [7699] LOG: database system is ready to accept connections
I20260808 23:35:35.281072 27455 mini_postgres.cc:96] Postgres bound to 51719
2026-08-08 23:35:35.306 UTC [7712] FATAL: database "slave" does not exist
127.26.207.212:51719 - accepting connections
I20260808 23:35:35.307461 27455 mini_ranger.cc:161] Starting Ranger...
I20260808 23:35:35.342929 27455 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 23:35:35.930382 27455 mini_ranger.cc:87] Created ranger Postgres database
I20260808 23:35:35.930490 27455 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-admin
2026-08-08 23:35:36,254 [I] DB FLAVOR :POSTGRES
2026-08-08 23:35:36,254 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 23:35:36,254 [I] Checking connection..
2026-08-08 23:35:36,255 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 23:35:36,531 [I] Checking connection passed.
2026-08-08 23:35:36,531 [I] --------- Verifying version history table ---------
2026-08-08 23:35:36,531 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 23:35:36,794 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 23:35:36,794 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 23:35:37,059 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 23:35:37,059 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 23:35:37,059 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 23:35:37.339 UTC [7787] WARNING: there is no transaction in progress
2026-08-08 23:35:37,347 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 23:35:37,348 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 23:35:37,630 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 23:35:37,630 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 23:35:37,631 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 23:35:37,880 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 23:35:38,149 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-1x4g.c.gcp-upstream.internal','N') ;"
2026-08-08 23:35:38,406 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 23:35:38,656 [I] Table x_portal_user does not exist in database ranger
2026-08-08 23:35:38,656 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 23:35:38,933 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 23:35:38,934 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 23:35:39,215 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 23:35:39,465 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 23:35:39,465 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 23:35:40.577 UTC [7907] WARNING: there is no transaction in progress
2026-08-08 23:35:40.598 UTC [7907] WARNING: there is no transaction in progress
2026-08-08 23:35:40.618 UTC [7907] WARNING: there is no transaction in progress
2026-08-08 23:35:40.636 UTC [7907] WARNING: there is no transaction in progress
2026-08-08 23:35:40.656 UTC [7907] WARNING: there is no transaction in progress
2026-08-08 23:35:40.676 UTC [7907] WARNING: there is no transaction in progress
2026-08-08 23:35:40.742 UTC [7907] WARNING: there is no transaction in progress
2026-08-08 23:35:40.751 UTC [7907] WARNING: there is no transaction in progress
2026-08-08 23:35:40.769 UTC [7907] WARNING: there is no transaction in progress
2026-08-08 23:35:40.781 UTC [7907] WARNING: there is no transaction in progress
2026-08-08 23:35:40.793 UTC [7907] WARNING: there is no transaction in progress
2026-08-08 23:35:40.812 UTC [7907] WARNING: there is no transaction in progress
2026-08-08 23:35:40.825 UTC [7907] WARNING: there is no transaction in progress
2026-08-08 23:35:40.833 UTC [7907] WARNING: there is no transaction in progress
2026-08-08 23:35:40.842 UTC [7907] WARNING: there is no transaction in progress
2026-08-08 23:35:40.850 UTC [7907] WARNING: there is no transaction in progress
2026-08-08 23:35:41,634 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 23:35:41,634 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 23:35:41,905 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 23:35:41,906 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 23:35:42,170 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 23:35:42,170 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 23:35:42,437 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 23:35:42,437 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 23:35:42,700 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 23:35:42,972 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-1x4g.c.gcp-upstream.internal';"
2026-08-08 23:35:43,227 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 23:35:43,228 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 23:35:43,505 [I] DB_PATCHES have already been applied
I20260808 23:35:43.512035 27455 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-admin:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskWgS6PY/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 23:35:43.512133 27455 mini_ranger.cc:193] Using host: 127.26.207.212
I20260808 23:35:43.534524 27455 mini_ranger.cc:227] Ranger admin URL: http://127.26.207.212:40085
Aug 08, 2026 11:35:43 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 11:35:43 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 11:35:44 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 11:35:44 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 11:35:44 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 11:35:44 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 11:35:44 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 23:35:44.760744 27455 mini_ranger.cc:160] Time spent starting Ranger: real 9.453s user 0.000s sys 0.067s
Aug 08, 2026 11:36:05 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 11:36:05 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 11:36:05 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 11:36:05 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 11:36:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 11:36:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 11:36:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 11:36:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 11:36:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 11:36:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 11:36:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 11:36:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 11:36:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 11:36:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 11:36:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 11:36:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 11:36:05 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 11:36:06 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 23:36:07.584164 27455 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.207.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.207.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.207.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/rangerkms_127.26.207.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.207.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/rangerkms_127.26.207.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.207.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.207.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.207.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/HTTP_127.26.207.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.207.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/HTTP_127.26.207.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 23:36:07 dist-test-slave-1x4g krb5kdc[7667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232167, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 23:36:07.823501 27455 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 23:36:07.853055 27455 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 23:36:08.865407 27455 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 23:36:08.865557 27455 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-kms
I20260808 23:36:08.865608 27455 mini_ranger_kms.cc:227] Using postgres at 127.26.207.212:51719
2026-08-08 23:36:09,255 [I] DB FLAVOR :POSTGRES
2026-08-08 23:36:09,256 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 23:36:09,256 [I] Checking connection
2026-08-08 23:36:09,256 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 23:36:09,522 [I] connection success
2026-08-08 23:36:09,522 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 23:36:09,522 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 23:36:09,522 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 23:36:09,801 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 23:36:09,801 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 23:36:09,802 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 23:36:09,802 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.207.212:51719/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 23:36:10,087 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 23:36:10.651552 27455 mini_ranger_kms.cc:310] Created kms service
I20260808 23:36:10.902935 27455 mini_ranger_kms.cc:326] Created kudu user
I20260808 23:36:10.955134 27455 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 23:36:10 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232167, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:36:11.398272 27455 mini_ranger_kms.cc:384] Added ranger policy
I20260808 23:36:11.398622 27455 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-kms:/tmp/dist-test-taskWgS6PY/build/asan/bin/postgresql.jar:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskWgS6PY/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 23:36:11.398690 27455 mini_ranger_kms.cc:240] Using host: 127.26.207.212
I20260808 23:36:11.422102 27455 mini_ranger_kms.cc:276] Ranger KMS PID: 8113
I20260808 23:36:11.422271 27455 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.207.212:44573
Aug 08, 2026 11:36:12 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 11:36:12 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 11:36:12 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 11:36:12 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 11:36:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 11:36:13 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 23:36:13.896445 27455 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.073s user 0.055s sys 0.372s
I20260808 23:36:13.896726 27455 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 23:36:13.896924 27455 mini_ranger_kms.cc:401] 127.26.207.212:44573/kms/v1/keys
Aug 08 23:36:14 dist-test-slave-1x4g krb5kdc[7667](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786232174, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.207.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 23:36:14 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232174, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.207.212@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
Aug 08 23:36:14 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232174, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.207.212@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
Aug 08 23:36:17 dist-test-slave-1x4g krb5kdc[7667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:36:17.406316 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:41121
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:40781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:41121
--ranger_config_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.207.212:44573/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:36:17.788842 8166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:17.789219 8166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:17.789443 8166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:17.797503 8166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:36:17.797639 8166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:17.797734 8166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:17.797842 8166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:36:17.797940 8166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:36:17.809396 8166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:40781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.207.212:44573/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:41121
--ranger_config_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:41121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:17.810936 8166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:17.812471 8166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:17.827365 8172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:17.827339 8171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:17.828102 8174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:17.828657 8166 server_base.cc:1034] running on GCE node
I20260808 23:36:17.829618 8166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:17.831391 8166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:17.832711 8166 hybrid_clock.cc:648] HybridClock initialized: now 1786232177832641 us; error 65 us; skew 500 ppm
I20260808 23:36:17.833206 8166 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:17 dist-test-slave-1x4g krb5kdc[7667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232177, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:17.837142 8166 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:36:17.839038 8166 webserver.cc:460] Webserver started at http://127.26.207.254:33847/ using document root <none> and password file <none>
I20260808 23:36:17.839829 8166 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:17.839990 8166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:17.840344 8166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 23:36:17 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232177, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:36:17.907266 8166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "91e33bcb2f2147b08575ebcd0374eba1"
format_stamp: "Formatted at 2026-08-08 23:36:17 on dist-test-slave-1x4g"
server_key: "353a82ad6b119720c5b5ffd00f9e34c0"
server_key_iv: "c9c8ff1fbedad82e8cd0cf81f5503ab8"
server_key_version: "kuduclusterkey@0"
I20260808 23:36:17.908232 8166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "91e33bcb2f2147b08575ebcd0374eba1"
format_stamp: "Formatted at 2026-08-08 23:36:17 on dist-test-slave-1x4g"
server_key: "353a82ad6b119720c5b5ffd00f9e34c0"
server_key_iv: "c9c8ff1fbedad82e8cd0cf81f5503ab8"
server_key_version: "kuduclusterkey@0"
I20260808 23:36:17.914489 8166 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 23:36:17.935772 8182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:17.937592 8166 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:36:17.937848 8166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "91e33bcb2f2147b08575ebcd0374eba1"
format_stamp: "Formatted at 2026-08-08 23:36:17 on dist-test-slave-1x4g"
server_key: "353a82ad6b119720c5b5ffd00f9e34c0"
server_key_iv: "c9c8ff1fbedad82e8cd0cf81f5503ab8"
server_key_version: "kuduclusterkey@0"
I20260808 23:36:17.938128 8166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:17.968039 8166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:17.973029 8166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:17.973387 8166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:17.995318 8166 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:41121
I20260808 23:36:17.995319 8238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:41121 every 8 connection(s)
I20260808 23:36:17.997042 8166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:36:18.001384 8239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:36:18.001982 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 8166
I20260808 23:36:18.002203 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:36:18.003059 27455 external_mini_cluster.cc:1428] Setting key 1f10a887413bbd0aef9fd5fa25b41eea
I20260808 23:36:18.022230 8239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1: Bootstrap starting.
I20260808 23:36:18.026588 8239 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1: Neither blocks nor log segments found. Creating new log.
I20260808 23:36:18.027824 8239 log.cc:824] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:18.031503 8239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1: No bootstrap required, opened a new log
Aug 08 23:36:18 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:36:18.041530 8239 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e33bcb2f2147b08575ebcd0374eba1" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41121 } }
I20260808 23:36:18.042074 8239 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:36:18.042249 8239 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e33bcb2f2147b08575ebcd0374eba1, State: Initialized, Role: FOLLOWER
I20260808 23:36:18.043114 8239 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e33bcb2f2147b08575ebcd0374eba1" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41121 } }
I20260808 23:36:18.043479 8239 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:36:18.043673 8239 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:36:18.043892 8239 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:36:18.047168 8239 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e33bcb2f2147b08575ebcd0374eba1" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41121 } }
I20260808 23:36:18.047839 8239 leader_election.cc:302] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91e33bcb2f2147b08575ebcd0374eba1; no voters:
I20260808 23:36:18.048270 8242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:18.005504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51860 (local address 127.26.207.254:41121)
0808 23:36:18.020228 (+ 14724us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:18.020247 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:18.020307 (+ 60us) server_negotiation.cc:407] Connection header received
0808 23:36:18.023063 (+ 2756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:18.023102 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:18.023707 (+ 605us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:18.024238 (+ 531us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:18.026204 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:18.028317 (+ 2113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:18.030437 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:18.031530 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:18.032581 (+ 1051us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:18.037429 (+ 4848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:18.037442 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:18.037467 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:18.037530 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:18.042108 (+ 4578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:18.043432 (+ 1324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:18.043444 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:18.043454 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:18.043738 (+ 284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:18.044368 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:18.044373 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:18.044377 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:18.045318 (+ 941us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:18.045682 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:18.046228 (+ 546us) server_negotiation.cc:299] Negotiation successful
0808 23:36:18.046709 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14392,"thread_start_us":16818,"threads_started":1}
I20260808 23:36:18.048656 8239 leader_election.cc:288] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:36:18.048799 8244 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:36:18.052907 8244 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 1 LEADER]: Becoming Leader. State: Replica: 91e33bcb2f2147b08575ebcd0374eba1, State: Running, Role: LEADER
I20260808 23:36:18.053709 8244 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e33bcb2f2147b08575ebcd0374eba1" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41121 } }
I20260808 23:36:18.057416 8245 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91e33bcb2f2147b08575ebcd0374eba1. Latest consensus state: current_term: 1 leader_uuid: "91e33bcb2f2147b08575ebcd0374eba1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e33bcb2f2147b08575ebcd0374eba1" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41121 } } }
I20260808 23:36:18.058736 8239 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:36:18.058959 8246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91e33bcb2f2147b08575ebcd0374eba1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e33bcb2f2147b08575ebcd0374eba1" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41121 } } }
I20260808 23:36:18.059526 8246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [sys.catalog]: This master's current role is: LEADER
I20260808 23:36:18.059309 8245 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [sys.catalog]: This master's current role is: LEADER
I20260808 23:36:18.065203 8249 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:36:18.073684 8249 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:36:18.077953 8239 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 23:36:18.096479 8249 catalog_manager.cc:1347] Generated new cluster ID: 93eb735736194e628abf2f7d35346f72
I20260808 23:36:18.096690 8249 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:36:18.120651 8249 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:36:18.122905 8249 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:36:18.146282 8249 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1: Generated new TSK 0
I20260808 23:36:18.147588 8249 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:36:18.909843 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.207.212:44573/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:41121
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:40781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 23:36:19 dist-test-slave-1x4g krb5kdc[7667](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786232179, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 23:36:19.445968 8286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:19.446458 8286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:19.446637 8286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:19.459002 8286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:19.459214 8286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:19.459470 8286 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:36:19.471166 8286 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:40781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.207.212:44573/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:41121
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:19.472689 8286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:19.474372 8286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:19.491087 8298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:19.498839 8297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:19.500041 8300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:19.501423 8286 server_base.cc:1034] running on GCE node
I20260808 23:36:19.502314 8286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:19.512697 8286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:19.514176 8286 hybrid_clock.cc:648] HybridClock initialized: now 1786232179514043 us; error 130 us; skew 500 ppm
I20260808 23:36:19.514720 8286 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:19 dist-test-slave-1x4g krb5kdc[7667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232179, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:19.519603 8286 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:36:19.526551 8286 webserver.cc:460] Webserver started at http://127.26.207.193:44065/ using document root <none> and password file <none>
I20260808 23:36:19.527781 8286 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:19.527977 8286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:19.528398 8286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 23:36:19 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232179, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:36:19.556941 8286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "bfe8a52f9cee4d5b903d433c81dfed78"
format_stamp: "Formatted at 2026-08-08 23:36:19 on dist-test-slave-1x4g"
server_key: "2ff00d62615707ec09a9a584c17c1ff3"
server_key_iv: "81d2511ff13a82c223ac4d2ccfb7411f"
server_key_version: "kuduclusterkey@0"
I20260808 23:36:19.558298 8286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "bfe8a52f9cee4d5b903d433c81dfed78"
format_stamp: "Formatted at 2026-08-08 23:36:19 on dist-test-slave-1x4g"
server_key: "2ff00d62615707ec09a9a584c17c1ff3"
server_key_iv: "81d2511ff13a82c223ac4d2ccfb7411f"
server_key_version: "kuduclusterkey@0"
I20260808 23:36:19.578929 8286 fs_manager.cc:691] Time spent creating directory manager: real 0.020s user 0.011s sys 0.004s
I20260808 23:36:19.615125 8309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:19.617573 8286 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.003s sys 0.008s
I20260808 23:36:19.617936 8286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "bfe8a52f9cee4d5b903d433c81dfed78"
format_stamp: "Formatted at 2026-08-08 23:36:19 on dist-test-slave-1x4g"
server_key: "2ff00d62615707ec09a9a584c17c1ff3"
server_key_iv: "81d2511ff13a82c223ac4d2ccfb7411f"
server_key_version: "kuduclusterkey@0"
I20260808 23:36:19.618327 8286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 08 23:36:19 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232179, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:36:19.723258 8286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:19.729646 8286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:19.730088 8286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:19.737630 8286 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:36:19.746024 8286 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:36:19.746214 8286 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 23:36:19.746387 8286 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:36:19.746480 8286 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:19.878331 8286 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:44699
I20260808 23:36:19.878343 8437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:44699 every 8 connection(s)
I20260808 23:36:19.879887 8286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:36:19.881817 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 8286
I20260808 23:36:19.882041 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:36:19.882893 27455 external_mini_cluster.cc:1428] Setting key 05da27484b7d2dc623838faeeb5635d9
Aug 08 23:36:19 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232179, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
I20260808 23:36:19.936708 8441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:19.885770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:51403 (local address 127.26.207.254:41121)
0808 23:36:19.910596 (+ 24826us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:19.910607 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:19.910647 (+ 40us) server_negotiation.cc:407] Connection header received
0808 23:36:19.915515 (+ 4868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:19.915522 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:19.915653 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:19.915798 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:19.917716 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:19.918921 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:19.921714 (+ 2793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:19.922435 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:19.922565 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:19.927917 (+ 5352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:19.927925 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:19.927930 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:19.927979 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:19.931955 (+ 3976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:19.933272 (+ 1317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:19.933279 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:19.933282 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:19.933475 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:19.934155 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:19.934160 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:19.934163 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:19.934577 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:19.934731 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:19.935942 (+ 1211us) server_negotiation.cc:299] Negotiation successful
0808 23:36:19.936255 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24611,"thread_start_us":24884,"threads_started":1}
I20260808 23:36:19.938832 8440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:19.884624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41121 (local address 127.26.207.193:51403)
0808 23:36:19.905982 (+ 21358us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:19.906083 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:19.914132 (+ 8049us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:19.916139 (+ 2007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:19.916149 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:19.916710 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:19.917491 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:19.917513 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:19.919184 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:19.919190 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:19.921461 (+ 2271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:19.921498 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:19.922999 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:19.923008 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:19.923376 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:19.924312 (+ 936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:19.924350 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:19.927522 (+ 3172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:19.932252 (+ 4730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:19.932263 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:19.932286 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:19.933083 (+ 797us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:19.933665 (+ 582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:19.933670 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:19.933675 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:19.933977 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:19.934841 (+ 864us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:19.934851 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:19.935408 (+ 557us) client_negotiation.cc:769] Sending connection context
0808 23:36:19.936588 (+ 1180us) client_negotiation.cc:240] Negotiation successful
0808 23:36:19.937295 (+ 707us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20806,"thread_start_us":24064,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
I20260808 23:36:19.941396 8438 heartbeater.cc:347] Connected to a master server at 127.26.207.254:41121
I20260808 23:36:19.941792 8438 heartbeater.cc:464] Registering TS with master...
I20260808 23:36:19.942967 8438 heartbeater.cc:511] Master 127.26.207.254:41121 requested a full tablet report, sending...
I20260808 23:36:19.946272 8203 ts_manager.cc:194] Registered new tserver with Master: bfe8a52f9cee4d5b903d433c81dfed78 (127.26.207.193:44699)
I20260808 23:36:19.948504 8203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:51403
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:36:19.985421 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.207.212:44573/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:41121
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:40781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 23:36:20 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232179, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
W20260808 23:36:20.463879 8444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:20.464257 8444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:20.464432 8444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:20.472579 8444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:20.472777 8444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:20.473001 8444 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:36:20.484593 8444 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:40781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.207.212:44573/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:41121
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:20.486541 8444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:20.488225 8444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:20.504187 8460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:20.504166 8462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:20.504237 8465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:20.510768 8444 server_base.cc:1034] running on GCE node
I20260808 23:36:20.511584 8444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:20.512729 8444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:20.514045 8444 hybrid_clock.cc:648] HybridClock initialized: now 1786232180513982 us; error 75 us; skew 500 ppm
I20260808 23:36:20.514467 8444 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:20 dist-test-slave-1x4g krb5kdc[7667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232180, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:20.518091 8444 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:36:20.519788 8444 webserver.cc:460] Webserver started at http://127.26.207.194:46271/ using document root <none> and password file <none>
I20260808 23:36:20.520583 8444 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:20.520699 8444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:20.521085 8444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 23:36:20 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232180, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:36:20.536417 8444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f"
format_stamp: "Formatted at 2026-08-08 23:36:20 on dist-test-slave-1x4g"
server_key: "679fde2464a22fdb96328046bd6ca005"
server_key_iv: "2217ba1c513351755ff6bd976d0b406c"
server_key_version: "kuduclusterkey@0"
I20260808 23:36:20.537534 8444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f"
format_stamp: "Formatted at 2026-08-08 23:36:20 on dist-test-slave-1x4g"
server_key: "679fde2464a22fdb96328046bd6ca005"
server_key_iv: "2217ba1c513351755ff6bd976d0b406c"
server_key_version: "kuduclusterkey@0"
I20260808 23:36:20.544353 8444 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 23:36:20.561065 8473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:20.563206 8444 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.003s
I20260808 23:36:20.563458 8444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f"
format_stamp: "Formatted at 2026-08-08 23:36:20 on dist-test-slave-1x4g"
server_key: "679fde2464a22fdb96328046bd6ca005"
server_key_iv: "2217ba1c513351755ff6bd976d0b406c"
server_key_version: "kuduclusterkey@0"
I20260808 23:36:20.563760 8444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:20.587967 8444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:20.592562 8444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:20.592959 8444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:20.594081 8444 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:36:20.595695 8444 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:36:20.595778 8444 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:20.595959 8444 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:36:20.596055 8444 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:20.632982 8444 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:32935
I20260808 23:36:20.632982 8600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:32935 every 8 connection(s)
I20260808 23:36:20.634495 8444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:36:20.637279 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 8444
I20260808 23:36:20.637503 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:36:20.638098 27455 external_mini_cluster.cc:1428] Setting key 4db5f40e4e8805f1bc18aa6c97468a2f
Aug 08 23:36:20 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232180, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:36:20.658995 8603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:20.637704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:43987 (local address 127.26.207.254:41121)
0808 23:36:20.638274 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:20.638279 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:20.639649 (+ 1370us) server_negotiation.cc:407] Connection header received
0808 23:36:20.642118 (+ 2469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:20.642124 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:20.642269 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:20.642414 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:20.644206 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:20.645154 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:20.647058 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:20.647509 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:20.647656 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:20.651762 (+ 4106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:20.651767 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:20.651771 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:20.651811 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:20.654833 (+ 3022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:20.656049 (+ 1216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:20.656054 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:20.656057 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:20.656245 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:20.656954 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:20.656959 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:20.656961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:20.657291 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:20.657426 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:20.658487 (+ 1061us) server_negotiation.cc:299] Negotiation successful
0808 23:36:20.658716 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":282,"threads_started":1}
I20260808 23:36:20.660827 8605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:20.638414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41121 (local address 127.26.207.194:43987)
0808 23:36:20.639432 (+ 1018us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:20.639508 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:20.641784 (+ 2276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:20.642756 (+ 972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:20.642773 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:20.643297 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:20.643986 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:20.644010 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:20.645492 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:20.645496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:20.646863 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:20.646880 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:20.647770 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:20.647779 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:20.648041 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:20.648866 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:20.648894 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:20.651435 (+ 2541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:20.655063 (+ 3628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:20.655078 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:20.655102 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:20.655870 (+ 768us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:20.656383 (+ 513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:20.656391 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:20.656398 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:20.656763 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:20.657443 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:20.657455 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:20.657981 (+ 526us) client_negotiation.cc:769] Sending connection context
0808 23:36:20.658379 (+ 398us) client_negotiation.cc:240] Negotiation successful
0808 23:36:20.659034 (+ 655us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":712,"thread_start_us":401,"threads_started":1}
I20260808 23:36:20.662616 8601 heartbeater.cc:347] Connected to a master server at 127.26.207.254:41121
I20260808 23:36:20.662981 8601 heartbeater.cc:464] Registering TS with master...
I20260808 23:36:20.664026 8601 heartbeater.cc:511] Master 127.26.207.254:41121 requested a full tablet report, sending...
I20260808 23:36:20.665877 8203 ts_manager.cc:194] Registered new tserver with Master: 374302c2a54a4bf8b1dcbd24cfba5e4f (127.26.207.194:32935)
I20260808 23:36:20.666754 8203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:43987
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:36:20.713287 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.207.212:44573/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:41121
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:40781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:36:20.953104 8438 heartbeater.cc:503] Master 127.26.207.254:41121 was elected leader, sending a full tablet report...
W20260808 23:36:21.104403 8609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:21.104802 8609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:21.105044 8609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:21.113667 8609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:21.113880 8609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:21.114087 8609 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:36:21.125213 8609 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:40781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.207.212:44573/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:41121
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:21.126806 8609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:21.128340 8609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:21.144436 8614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:21.144418 8615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:21.144920 8617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:21.146234 8609 server_base.cc:1034] running on GCE node
I20260808 23:36:21.147003 8609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:21.148378 8609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:21.149775 8609 hybrid_clock.cc:648] HybridClock initialized: now 1786232181149673 us; error 89 us; skew 500 ppm
I20260808 23:36:21.150336 8609 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:21 dist-test-slave-1x4g krb5kdc[7667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232181, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:21.154776 8609 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:36:21.156682 8609 webserver.cc:460] Webserver started at http://127.26.207.195:46231/ using document root <none> and password file <none>
I20260808 23:36:21.157632 8609 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:21.157814 8609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:21.158205 8609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 23:36:21 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232181, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:36:21.178190 8609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "fda2a84342184cefb7fd8cdc45181350"
format_stamp: "Formatted at 2026-08-08 23:36:21 on dist-test-slave-1x4g"
server_key: "c4af78d4539b2b1f928a5393bdfea9bc"
server_key_iv: "1c051c67ed890d94a722772a00af83a6"
server_key_version: "kuduclusterkey@0"
I20260808 23:36:21.179539 8609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "fda2a84342184cefb7fd8cdc45181350"
format_stamp: "Formatted at 2026-08-08 23:36:21 on dist-test-slave-1x4g"
server_key: "c4af78d4539b2b1f928a5393bdfea9bc"
server_key_iv: "1c051c67ed890d94a722772a00af83a6"
server_key_version: "kuduclusterkey@0"
I20260808 23:36:21.188763 8609 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.007s sys 0.003s
I20260808 23:36:21.210182 8625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:21.212327 8609 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260808 23:36:21.212761 8609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "fda2a84342184cefb7fd8cdc45181350"
format_stamp: "Formatted at 2026-08-08 23:36:21 on dist-test-slave-1x4g"
server_key: "c4af78d4539b2b1f928a5393bdfea9bc"
server_key_iv: "1c051c67ed890d94a722772a00af83a6"
server_key_version: "kuduclusterkey@0"
I20260808 23:36:21.213236 8609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:21.239270 8609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:21.244300 8609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:21.244652 8609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:21.245774 8609 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:36:21.247453 8609 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:36:21.247536 8609 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:21.247740 8609 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:36:21.247812 8609 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:21.286823 8609 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:34475
I20260808 23:36:21.286855 8751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:34475 every 8 connection(s)
I20260808 23:36:21.289661 8609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:36:21.298350 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 8609
I20260808 23:36:21.298544 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:36:21.299158 27455 external_mini_cluster.cc:1428] Setting key ee8552fe79b10135b8a079b997d48396
Aug 08 23:36:21 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232181, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:36:21.315218 8754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:21.292925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:44195 (local address 127.26.207.254:41121)
0808 23:36:21.293453 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:21.293461 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:21.294754 (+ 1293us) server_negotiation.cc:407] Connection header received
0808 23:36:21.296752 (+ 1998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:21.296757 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:21.296934 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:21.297053 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:21.299006 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:21.300032 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:21.302180 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:21.302901 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:21.303018 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:21.307804 (+ 4786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:21.307811 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:21.307814 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:21.307864 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:21.311061 (+ 3197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:21.312080 (+ 1019us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:21.312085 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:21.312088 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:21.312243 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:21.312979 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:21.312984 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:21.312986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:21.313312 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:21.313442 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:21.314613 (+ 1171us) server_negotiation.cc:299] Negotiation successful
0808 23:36:21.314871 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":257,"threads_started":1}
I20260808 23:36:21.316478 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:21.293650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41121 (local address 127.26.207.195:44195)
0808 23:36:21.294539 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:21.294601 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:21.296409 (+ 1808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:21.297324 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:21.297334 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:21.297842 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:21.298778 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:21.298802 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:21.300223 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:21.300229 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:21.302000 (+ 1771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:21.302024 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:21.303206 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:21.303212 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:21.303476 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:21.304369 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:21.304397 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:21.307430 (+ 3033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:21.311299 (+ 3869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:21.311308 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:21.311326 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:21.311876 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:21.312464 (+ 588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:21.312469 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:21.312471 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:21.312722 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:21.313569 (+ 847us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:21.313580 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:21.314107 (+ 527us) client_negotiation.cc:769] Sending connection context
0808 23:36:21.314433 (+ 326us) client_negotiation.cc:240] Negotiation successful
0808 23:36:21.315075 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":383,"threads_started":1}
I20260808 23:36:21.318022 8752 heartbeater.cc:347] Connected to a master server at 127.26.207.254:41121
I20260808 23:36:21.318392 8752 heartbeater.cc:464] Registering TS with master...
I20260808 23:36:21.319388 8752 heartbeater.cc:511] Master 127.26.207.254:41121 requested a full tablet report, sending...
I20260808 23:36:21.321229 8203 ts_manager.cc:194] Registered new tserver with Master: fda2a84342184cefb7fd8cdc45181350 (127.26.207.195:34475)
I20260808 23:36:21.322099 8203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:44195
I20260808 23:36:21.329350 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:36:21.331130 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 8286
Aug 08 23:36:21 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:36:21.351567 8757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:21.332265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42560 (local address 127.26.207.193:44699)
0808 23:36:21.333023 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:21.333031 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:21.333061 (+ 30us) server_negotiation.cc:407] Connection header received
0808 23:36:21.333125 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:21.333132 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:21.333354 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:21.333505 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:21.335293 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:21.336394 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:21.338430 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:21.339072 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:21.339219 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:21.344280 (+ 5061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:21.344303 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:21.344321 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:21.344368 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:21.347734 (+ 3366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:21.348871 (+ 1137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:21.348885 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:21.348888 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:21.349094 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:21.349672 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:21.349676 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:21.349678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:21.350082 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:21.350351 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:21.350794 (+ 443us) server_negotiation.cc:299] Negotiation successful
0808 23:36:21.351123 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":590,"thread_start_us":365,"threads_started":1}
I20260808 23:36:21.353228 8430 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:21.443614 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 8286
I20260808 23:36:21.463490 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 8444
Aug 08 23:36:21 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:36:21.486917 8760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:21.464476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50754 (local address 127.26.207.194:32935)
0808 23:36:21.465141 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:21.465148 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:21.465177 (+ 29us) server_negotiation.cc:407] Connection header received
0808 23:36:21.465243 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:21.465250 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:21.465482 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:21.465621 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:21.467095 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:21.468179 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:21.469890 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:21.470610 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:21.470735 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:21.480578 (+ 9843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:21.480597 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:21.480614 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:21.480661 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:21.483883 (+ 3222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:21.484767 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:21.484936 (+ 169us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:21.484938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:21.485108 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:21.485497 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:21.485500 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:21.485502 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:21.485865 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:21.486134 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:21.486390 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 23:36:21.486620 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":367,"threads_started":1}
I20260808 23:36:21.488262 8595 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:21.574239 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 8444
I20260808 23:36:21.594074 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 8609
Aug 08 23:36:21 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:36:21.612533 8762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:21.595317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37036 (local address 127.26.207.195:34475)
0808 23:36:21.596053 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:21.596060 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:21.596092 (+ 32us) server_negotiation.cc:407] Connection header received
0808 23:36:21.596166 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:21.596173 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:21.596396 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:21.596535 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:21.597982 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:21.599044 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:21.600422 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:21.601185 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:21.601305 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:21.606201 (+ 4896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:21.606220 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:21.606236 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:21.606288 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:21.609407 (+ 3119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:21.610334 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:21.610344 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:21.610346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:21.610520 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:21.610950 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:21.610954 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:21.610956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:21.611374 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:21.611637 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:21.611998 (+ 361us) server_negotiation.cc:299] Negotiation successful
0808 23:36:21.612231 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":398,"threads_started":1}
I20260808 23:36:21.614377 8747 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:21.703910 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 8609
I20260808 23:36:21.724434 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 8166
I20260808 23:36:21.725946 8234 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:21.837258 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 8166
I20260808 23:36:21.864312 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:41121
--webserver_interface=127.26.207.254
--webserver_port=33847
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:40781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:41121
--ranger_config_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.207.212:44573/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.207.212:44573/kms with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:36:22.225677 8766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:22.226020 8766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:22.226192 8766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:22.233955 8766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:36:22.234099 8766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:22.234253 8766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:22.234370 8766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:36:22.234452 8766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:36:22.245594 8766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:40781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.207.212:44573/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:41121
--ranger_config_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:41121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=33847
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:22.247116 8766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:22.248622 8766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:22.262014 8772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:22.262063 8773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:22.262089 8775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:22.263032 8766 server_base.cc:1034] running on GCE node
I20260808 23:36:22.263993 8766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:22.265834 8766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:22.267145 8766 hybrid_clock.cc:648] HybridClock initialized: now 1786232182267083 us; error 86 us; skew 500 ppm
I20260808 23:36:22.267616 8766 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:22 dist-test-slave-1x4g krb5kdc[7667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232182, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:22.271215 8766 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:36:22.273046 8766 webserver.cc:460] Webserver started at http://127.26.207.254:33847/ using document root <none> and password file <none>
I20260808 23:36:22.273831 8766 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:22.274004 8766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 23:36:22 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232182, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:36:22.359092 8766 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 23:36:22.362470 8783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:22.364058 8766 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:36:22.364316 8766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "91e33bcb2f2147b08575ebcd0374eba1"
format_stamp: "Formatted at 2026-08-08 23:36:17 on dist-test-slave-1x4g"
server_key: "353a82ad6b119720c5b5ffd00f9e34c0"
server_key_iv: "c9c8ff1fbedad82e8cd0cf81f5503ab8"
server_key_version: "kuduclusterkey@0"
I20260808 23:36:22.365528 8766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:22.382263 8766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:22.387063 8766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:22.387449 8766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:22.409466 8766 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:41121
I20260808 23:36:22.409508 8840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:41121 every 8 connection(s)
I20260808 23:36:22.411175 8766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:36:22.418020 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 8766
I20260808 23:36:22.418994 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.207.212:44573/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:44699
--local_ip_for_outbound_sockets=127.26.207.193
--tserver_master_addrs=127.26.207.254:41121
--webserver_port=44065
--webserver_interface=127.26.207.193
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:40781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.207.212:44573/kms with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:36:22.419094 8841 sys_catalog.cc:263] Verifying existing consensus state
I20260808 23:36:22.422950 8841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1: Bootstrap starting.
I20260808 23:36:22.443533 8841 log.cc:824] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:22.454190 8841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 23:36:22.454842 8841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1: Bootstrap complete.
I20260808 23:36:22.465548 8841 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e33bcb2f2147b08575ebcd0374eba1" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41121 } }
I20260808 23:36:22.466590 8841 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e33bcb2f2147b08575ebcd0374eba1, State: Initialized, Role: FOLLOWER
I20260808 23:36:22.467344 8841 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e33bcb2f2147b08575ebcd0374eba1" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41121 } }
I20260808 23:36:22.467623 8841 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:36:22.467770 8841 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:36:22.467976 8841 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 1 FOLLOWER]: Advancing to term 2
I20260808 23:36:22.472930 8841 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e33bcb2f2147b08575ebcd0374eba1" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41121 } }
I20260808 23:36:22.473572 8841 leader_election.cc:302] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91e33bcb2f2147b08575ebcd0374eba1; no voters:
I20260808 23:36:22.474247 8841 leader_election.cc:288] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 23:36:22.474512 8845 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 23:36:22.475683 8845 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [term 2 LEADER]: Becoming Leader. State: Replica: 91e33bcb2f2147b08575ebcd0374eba1, State: Running, Role: LEADER
I20260808 23:36:22.476531 8841 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:36:22.476429 8845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e33bcb2f2147b08575ebcd0374eba1" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41121 } }
I20260808 23:36:22.484241 8841 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 23:36:22.484172 8847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91e33bcb2f2147b08575ebcd0374eba1. Latest consensus state: current_term: 2 leader_uuid: "91e33bcb2f2147b08575ebcd0374eba1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e33bcb2f2147b08575ebcd0374eba1" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41121 } } }
I20260808 23:36:22.484637 8847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [sys.catalog]: This master's current role is: LEADER
I20260808 23:36:22.492348 8846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "91e33bcb2f2147b08575ebcd0374eba1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e33bcb2f2147b08575ebcd0374eba1" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41121 } } }
I20260808 23:36:22.492723 8846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1 [sys.catalog]: This master's current role is: LEADER
I20260808 23:36:22.493866 8861 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:36:22.510459 8861 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:36:22.512909 8861 catalog_manager.cc:1259] Loaded cluster ID: 93eb735736194e628abf2f7d35346f72
I20260808 23:36:22.513099 8861 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:36:22.518955 8861 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:36:22.521565 8861 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1: Loaded TSK: 0
I20260808 23:36:22.523801 8861 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 23:36:22.936692 8843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:22.937263 8843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:22.937490 8843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:22.949236 8843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:22.949419 8843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:22.949688 8843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:36:22.965147 8843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:40781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.207.212:44573/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:44699
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=44065
--tserver_master_addrs=127.26.207.254:41121
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:22.967190 8843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:22.969364 8843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:23.016630 8882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:23.016633 8884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:23.018985 8881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:23.029307 8843 server_base.cc:1034] running on GCE node
I20260808 23:36:23.030306 8843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:23.031795 8843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:23.033053 8843 hybrid_clock.cc:648] HybridClock initialized: now 1786232183032970 us; error 66 us; skew 500 ppm
I20260808 23:36:23.033485 8843 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:23 dist-test-slave-1x4g krb5kdc[7667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232183, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:23.037810 8843 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:36:23.057150 8843 webserver.cc:460] Webserver started at http://127.26.207.193:44065/ using document root <none> and password file <none>
I20260808 23:36:23.058492 8843 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:23.058807 8843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 23:36:23 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232183, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:36:23.095849 8843 fs_manager.cc:709] Time spent opening directory manager: real 0.012s user 0.000s sys 0.010s
I20260808 23:36:23.105687 8894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:23.108110 8843 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.000s sys 0.008s
I20260808 23:36:23.108373 8843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "bfe8a52f9cee4d5b903d433c81dfed78"
format_stamp: "Formatted at 2026-08-08 23:36:19 on dist-test-slave-1x4g"
server_key: "2ff00d62615707ec09a9a584c17c1ff3"
server_key_iv: "81d2511ff13a82c223ac4d2ccfb7411f"
server_key_version: "kuduclusterkey@0"
I20260808 23:36:23.110112 8843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:23.147768 8843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:23.153313 8843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:23.153740 8843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:23.161194 8843 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:36:23.163151 8843 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:36:23.163298 8843 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:23.163452 8843 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:36:23.163543 8843 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:23.213992 8843 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:44699
I20260808 23:36:23.214102 9023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:44699 every 8 connection(s)
I20260808 23:36:23.216355 8843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:36:23.225481 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 8843
I20260808 23:36:23.226362 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.207.212:44573/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:32935
--local_ip_for_outbound_sockets=127.26.207.194
--tserver_master_addrs=127.26.207.254:41121
--webserver_port=46271
--webserver_interface=127.26.207.194
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:40781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.207.212:44573/kms with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 23:36:23 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232183, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:36:23.254691 9028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:23.228191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:38777 (local address 127.26.207.254:41121)
0808 23:36:23.229202 (+ 1011us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:23.229223 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:23.229281 (+ 58us) server_negotiation.cc:407] Connection header received
0808 23:36:23.230894 (+ 1613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:23.230908 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:23.231308 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:23.231762 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:23.233730 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:23.235224 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:23.237070 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:23.237796 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:23.238053 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:23.243212 (+ 5159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:23.243228 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:23.243253 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:23.243332 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:23.247889 (+ 4557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:23.249259 (+ 1370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:23.249272 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:23.249281 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:23.249560 (+ 279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:23.250303 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:23.250308 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:23.250311 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:23.251161 (+ 850us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:23.251409 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:23.252772 (+ 1363us) server_negotiation.cc:299] Negotiation successful
0808 23:36:23.253414 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":310,"threads_started":1}
I20260808 23:36:23.256992 9026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:23.226840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41121 (local address 127.26.207.193:38777)
0808 23:36:23.227799 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:23.227869 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:23.230153 (+ 2284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:23.231916 (+ 1763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:23.231929 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:23.232634 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:23.233438 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:23.233464 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:23.235447 (+ 1983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:23.235451 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:23.236890 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:23.236907 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:23.238105 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:23.238114 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:23.238433 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:23.239422 (+ 989us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:23.239468 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:23.242726 (+ 3258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:23.248186 (+ 5460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:23.248198 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:23.248217 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:23.249034 (+ 817us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:23.249769 (+ 735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:23.249774 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:23.249777 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:23.250113 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:23.251534 (+ 1421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:23.251544 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:23.252072 (+ 528us) client_negotiation.cc:769] Sending connection context
0808 23:36:23.255356 (+ 3284us) client_negotiation.cc:240] Negotiation successful
0808 23:36:23.255853 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":704,"threads_started":1}
I20260808 23:36:23.261646 9024 heartbeater.cc:347] Connected to a master server at 127.26.207.254:41121
I20260808 23:36:23.262037 9024 heartbeater.cc:464] Registering TS with master...
I20260808 23:36:23.262850 9024 heartbeater.cc:511] Master 127.26.207.254:41121 requested a full tablet report, sending...
W20260808 23:36:23.266909 9024 heartbeater.cc:644] Failed to heartbeat to 127.26.207.254:41121 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 23:36:23.267261 9024 heartbeater.cc:464] Registering TS with master...
I20260808 23:36:23.267617 9024 heartbeater.cc:511] Master 127.26.207.254:41121 requested a full tablet report, sending...
I20260808 23:36:23.269469 9024 heartbeater.cc:464] Registering TS with master...
I20260808 23:36:23.269836 9024 heartbeater.cc:511] Master 127.26.207.254:41121 requested a full tablet report, sending...
W20260808 23:36:23.271358 9024 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 23:36:23.748137 9029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:23.748682 9029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:23.751591 9029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:23.764437 9029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:23.764683 9029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:23.764926 9029 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:36:23.782258 9029 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:40781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.207.212:44573/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:32935
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=46271
--tserver_master_addrs=127.26.207.254:41121
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:23.784581 9029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:23.786720 9029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:23.807298 9050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:23.807415 9051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:23.815433 9053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:23.816488 9029 server_base.cc:1034] running on GCE node
I20260808 23:36:23.817780 9029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:23.822923 9029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:23.824337 9029 hybrid_clock.cc:648] HybridClock initialized: now 1786232183824255 us; error 100 us; skew 500 ppm
I20260808 23:36:23.824894 9029 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:23 dist-test-slave-1x4g krb5kdc[7667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232183, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:23.830098 9029 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:36:23.833958 9029 webserver.cc:460] Webserver started at http://127.26.207.194:46271/ using document root <none> and password file <none>
I20260808 23:36:23.835117 9029 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:23.835336 9029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 23:36:23 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232183, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:36:23.859604 9029 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.000s sys 0.006s
I20260808 23:36:23.863375 9061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:23.865224 9029 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:36:23.865464 9029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f"
format_stamp: "Formatted at 2026-08-08 23:36:20 on dist-test-slave-1x4g"
server_key: "679fde2464a22fdb96328046bd6ca005"
server_key_iv: "2217ba1c513351755ff6bd976d0b406c"
server_key_version: "kuduclusterkey@0"
I20260808 23:36:23.866611 9029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 08 23:36:23 dist-test-slave-1x4g krb5kdc[7667](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786232183, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:23.888729 9029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:23.894869 9029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:23.895242 9029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:23.897286 9029 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:36:23.899675 9029 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:36:23.899897 9029 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 23:36:23.900104 9029 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:36:23.900242 9029 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:23.967643 9029 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:32935
I20260808 23:36:23.967701 9187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:32935 every 8 connection(s)
I20260808 23:36:23.969372 9029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:36:23.976281 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 9029
I20260808 23:36:23.977211 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.207.212:44573/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:34475
--local_ip_for_outbound_sockets=127.26.207.195
--tserver_master_addrs=127.26.207.254:41121
--webserver_port=46231
--webserver_interface=127.26.207.195
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:40781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.207.212:44573/kms with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 23:36:23 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232183, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:36:23.999799 9190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:23.972990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:59069 (local address 127.26.207.254:41121)
0808 23:36:23.977419 (+ 4429us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:23.977591 (+ 172us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:23.977620 (+ 29us) server_negotiation.cc:407] Connection header received
0808 23:36:23.980631 (+ 3011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:23.980640 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:23.980757 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:23.980910 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:23.983226 (+ 2316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:23.984458 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:23.987349 (+ 2891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:23.988121 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:23.988252 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:23.993120 (+ 4868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:23.993127 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:23.993130 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:23.993171 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:23.996223 (+ 3052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:23.997251 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:23.997257 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:23.997261 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:23.997406 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:23.997899 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:23.997904 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:23.997908 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:23.998218 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:23.998391 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:23.999147 (+ 756us) server_negotiation.cc:299] Negotiation successful
0808 23:36:23.999400 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4282,"thread_start_us":7683,"threads_started":1}
I20260808 23:36:24.001019 9191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:23.973635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41121 (local address 127.26.207.194:59069)
0808 23:36:23.976853 (+ 3218us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:23.976925 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:23.980217 (+ 3292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:23.981301 (+ 1084us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:23.981316 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:23.981996 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:23.982958 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:23.982990 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:23.984699 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:23.984708 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:23.987100 (+ 2392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:23.987127 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:23.988653 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:23.988662 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:23.989091 (+ 429us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:23.990047 (+ 956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:23.990086 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:23.992672 (+ 2586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:23.996437 (+ 3765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:23.996448 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:23.996470 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:23.997094 (+ 624us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:23.997543 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:23.997547 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:23.997550 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:23.997762 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:23.998365 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:23.998374 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:23.998718 (+ 344us) client_negotiation.cc:769] Sending connection context
0808 23:36:23.999020 (+ 302us) client_negotiation.cc:240] Negotiation successful
0808 23:36:23.999634 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2835,"thread_start_us":2573,"threads_started":1}
I20260808 23:36:24.003217 9188 heartbeater.cc:347] Connected to a master server at 127.26.207.254:41121
I20260808 23:36:24.003613 9188 heartbeater.cc:464] Registering TS with master...
I20260808 23:36:24.004637 9188 heartbeater.cc:511] Master 127.26.207.254:41121 requested a full tablet report, sending...
I20260808 23:36:24.007187 8803 ts_manager.cc:194] Registered new tserver with Master: 374302c2a54a4bf8b1dcbd24cfba5e4f (127.26.207.194:32935)
I20260808 23:36:24.009596 8803 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:59069
I20260808 23:36:24.271522 9024 heartbeater.cc:464] Registering TS with master...
I20260808 23:36:24.272032 9024 heartbeater.cc:511] Master 127.26.207.254:41121 requested a full tablet report, sending...
I20260808 23:36:24.273562 8803 ts_manager.cc:194] Registered new tserver with Master: bfe8a52f9cee4d5b903d433c81dfed78 (127.26.207.193:44699)
I20260808 23:36:24.274820 8803 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:38777
Aug 08 23:36:24 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232183, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
W20260808 23:36:24.508422 9193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:24.508919 9193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:24.509107 9193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:24.521466 9193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:24.521612 9193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:24.521798 9193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:36:24.532377 9193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:40781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.207.212:44573/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:34475
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=46231
--tserver_master_addrs=127.26.207.254:41121
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:24.533916 9193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:24.535403 9193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:24.550441 9199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:24.551062 9198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:24.551036 9201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:24.551615 9193 server_base.cc:1034] running on GCE node
I20260808 23:36:24.552630 9193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:24.554908 9193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:24.556212 9193 hybrid_clock.cc:648] HybridClock initialized: now 1786232184556143 us; error 76 us; skew 500 ppm
I20260808 23:36:24.556617 9193 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:24 dist-test-slave-1x4g krb5kdc[7667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232184, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:24.560232 9193 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:36:24.566517 9193 webserver.cc:460] Webserver started at http://127.26.207.195:46231/ using document root <none> and password file <none>
I20260808 23:36:24.567371 9193 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:24.567579 9193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 23:36:24 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232184, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:36:24.602826 9193 fs_manager.cc:709] Time spent opening directory manager: real 0.010s user 0.007s sys 0.002s
I20260808 23:36:24.609462 9209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:24.611315 9193 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.006s sys 0.001s
I20260808 23:36:24.611538 9193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "fda2a84342184cefb7fd8cdc45181350"
format_stamp: "Formatted at 2026-08-08 23:36:21 on dist-test-slave-1x4g"
server_key: "c4af78d4539b2b1f928a5393bdfea9bc"
server_key_iv: "1c051c67ed890d94a722772a00af83a6"
server_key_version: "kuduclusterkey@0"
I20260808 23:36:24.612663 9193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:24.635711 9193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:24.640439 9193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:24.640830 9193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:24.642051 9193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:36:24.643724 9193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:36:24.643859 9193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:24.644009 9193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:36:24.644114 9193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:24.698954 9193 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:34475
I20260808 23:36:24.699056 9331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:34475 every 8 connection(s)
I20260808 23:36:24.701628 9193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:36:24.709280 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 9193
Aug 08 23:36:24 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232184, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
Aug 08 23:36:24 dist-test-slave-1x4g krb5kdc[7667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232183, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for HTTP/127.26.207.212@KRBTEST.COM
I20260808 23:36:24.771713 9336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:24.711434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51746 (local address 127.26.207.254:41121)
0808 23:36:24.734478 (+ 23044us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:24.734486 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:24.737961 (+ 3475us) server_negotiation.cc:407] Connection header received
0808 23:36:24.738211 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:24.738217 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:24.738786 (+ 569us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:24.738913 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:24.741544 (+ 2631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.742671 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.744867 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.745502 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.745636 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:24.749857 (+ 4221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:24.749866 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:24.749871 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:24.749935 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:24.758436 (+ 8501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:24.759846 (+ 1410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:24.759854 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:24.759857 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:24.760067 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:24.760972 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:24.760978 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:24.760982 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:24.761569 (+ 587us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:24.761917 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:24.770910 (+ 8993us) server_negotiation.cc:299] Negotiation successful
0808 23:36:24.771286 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22883,"thread_start_us":19786,"threads_started":1}
I20260808 23:36:24.776146 9338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:24.706968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:41685 (local address 127.26.207.254:41121)
0808 23:36:24.731217 (+ 24249us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:24.731225 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:24.737288 (+ 6063us) server_negotiation.cc:407] Connection header received
0808 23:36:24.739560 (+ 2272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:24.739567 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:24.739674 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:24.739761 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:24.742663 (+ 2902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.743979 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.752958 (+ 8979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.753749 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.753924 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:24.762034 (+ 8110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:24.762043 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:24.762048 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:24.762094 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:24.769502 (+ 7408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:24.771971 (+ 2469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:24.771979 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:24.771982 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:24.772178 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:24.773669 (+ 1491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:24.773675 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:24.773679 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:24.774079 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:24.774219 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:24.775416 (+ 1197us) server_negotiation.cc:299] Negotiation successful
0808 23:36:24.775693 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24090,"thread_start_us":27523,"threads_started":1}
I20260808 23:36:24.779389 9335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:24.706155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41121 (local address 127.26.207.195:41685)
0808 23:36:24.735280 (+ 29125us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:24.735353 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:24.739010 (+ 3657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:24.740539 (+ 1529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:24.740556 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:24.741238 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:24.742407 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:24.742437 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.745310 (+ 2873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.745316 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:24.752536 (+ 7220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:24.752569 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.755669 (+ 3100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.755683 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:24.756117 (+ 434us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:24.757503 (+ 1386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:24.757539 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:24.761655 (+ 4116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:24.769769 (+ 8114us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:24.769782 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:24.769805 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:24.770618 (+ 813us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:24.772425 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:24.772431 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:24.772435 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:24.772804 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:24.774348 (+ 1544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:24.774359 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:24.774882 (+ 523us) client_negotiation.cc:769] Sending connection context
0808 23:36:24.776597 (+ 1715us) client_negotiation.cc:240] Negotiation successful
0808 23:36:24.777555 (+ 958us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28689,"thread_start_us":29770,"threads_started":1}
I20260808 23:36:24.781126 9332 heartbeater.cc:347] Connected to a master server at 127.26.207.254:41121
I20260808 23:36:24.781468 9332 heartbeater.cc:464] Registering TS with master...
I20260808 23:36:24.782418 9332 heartbeater.cc:511] Master 127.26.207.254:41121 requested a full tablet report, sending...
I20260808 23:36:24.784617 8803 ts_manager.cc:194] Registered new tserver with Master: fda2a84342184cefb7fd8cdc45181350 (127.26.207.195:34475)
I20260808 23:36:24.786084 8803 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:41685
I20260808 23:36:24.792266 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:36:24.843302 9338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:24.815115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51752 (local address 127.26.207.254:41121)
0808 23:36:24.815350 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:24.815357 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:24.822466 (+ 7109us) server_negotiation.cc:407] Connection header received
0808 23:36:24.822699 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:24.822705 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:24.822812 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:24.822934 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:24.825909 (+ 2975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.827034 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.829610 (+ 2576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.830459 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.830607 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:24.835083 (+ 4476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:24.835093 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:24.835097 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:24.835155 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:24.839243 (+ 4088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:24.840442 (+ 1199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:24.840449 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:24.840453 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:24.840632 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:24.841232 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:24.841238 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:24.841242 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:24.841672 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:24.841921 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:24.842623 (+ 702us) server_negotiation.cc:299] Negotiation successful
0808 23:36:24.842934 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 23:36:24.851691 8803 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51752:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:36:24.864200 8803 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:36:24.958362 9351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:24.919944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42574 (local address 127.26.207.193:44699)
0808 23:36:24.937441 (+ 17497us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:24.937456 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:24.945157 (+ 7701us) server_negotiation.cc:407] Connection header received
0808 23:36:24.948190 (+ 3033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:24.948202 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:24.948531 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:24.948737 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:36:24.949981 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.951702 (+ 1721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.954805 (+ 3103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.956466 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.956686 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:24.956945 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:24.957763 (+ 818us) server_negotiation.cc:299] Negotiation successful
0808 23:36:24.957981 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17228,"thread_start_us":16999,"threads_started":1}
I20260808 23:36:24.963284 9352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:24.919789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:44699 (local address 127.0.0.1:42574)
0808 23:36:24.944889 (+ 25100us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:24.944959 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:24.947811 (+ 2852us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:24.949183 (+ 1372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:24.949191 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:24.949225 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:36:24.949704 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:24.949720 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.951948 (+ 2228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.951954 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:24.954574 (+ 2620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:24.954593 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.957182 (+ 2589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.957189 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:24.957428 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:24.957496 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 23:36:24.958797 (+ 1301us) client_negotiation.cc:240] Negotiation successful
0808 23:36:24.959065 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22323,"thread_start_us":27644,"threads_started":1}
I20260808 23:36:24.968521 9353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:24.923186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50760 (local address 127.26.207.194:32935)
0808 23:36:24.938646 (+ 15460us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:24.938653 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:24.947276 (+ 8623us) server_negotiation.cc:407] Connection header received
0808 23:36:24.951335 (+ 4059us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:24.951345 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:24.951632 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:24.951813 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:36:24.952895 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.956117 (+ 3222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.963013 (+ 6896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.964735 (+ 1722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.964979 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:24.965180 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:24.967869 (+ 2689us) server_negotiation.cc:299] Negotiation successful
0808 23:36:24.968088 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15292,"thread_start_us":15465,"threads_started":1}
I20260808 23:36:24.969023 9354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:24.922982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:32935 (local address 127.0.0.1:50760)
0808 23:36:24.946955 (+ 23973us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:24.946990 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:24.948561 (+ 1571us) spinlock_profiling.cc:243] Waited 948 us on lock 0x61200002cc28. stack: 00007f5f133be66e 00007f5f133be430 00007f5f124455ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f5f133b40fd 00007f5f133b3d1e 00007f5f262bd3cd 00007f5f262bd36c 00007f5f26289b3b 00007f5f19dc3536 00007f5f19dc1d9e 00007f5f19e49dca 00007f5f19e47f68 00007f5f19e7b82f
0808 23:36:24.948599 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:24.952163 (+ 3564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:24.952168 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:24.952202 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:36:24.952646 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:24.952662 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.960453 (+ 7791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.960465 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:24.962720 (+ 2255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:24.962748 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.965317 (+ 2569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.965324 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:24.965543 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:24.965582 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 23:36:24.965687 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 23:36:24.965848 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23828,"spinlock_wait_cycles":2179840,"thread_start_us":18876,"threads_started":1}
I20260808 23:36:24.971243 8949 tablet_service.cc:1467] Processing CreateTablet for tablet 5c24913f45254bdfab00bb30efb17d30 (DEFAULT_TABLE table=test-table [id=8355dbd9982941bf95d7dfc53ec46935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:36:24.973093 8949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c24913f45254bdfab00bb30efb17d30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:36:24.973788 9116 tablet_service.cc:1467] Processing CreateTablet for tablet 5c24913f45254bdfab00bb30efb17d30 (DEFAULT_TABLE table=test-table [id=8355dbd9982941bf95d7dfc53ec46935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:36:24.975374 9116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c24913f45254bdfab00bb30efb17d30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:36:24.994058 9350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:24.931879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:34475 (local address 127.0.0.1:37044)
0808 23:36:24.947772 (+ 15893us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:24.947791 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:24.947923 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:24.956320 (+ 8397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:24.956327 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:24.956365 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:36:24.956804 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:24.956821 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.980871 (+ 24050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.980879 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:24.983077 (+ 2198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:24.983102 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.992965 (+ 9863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.992975 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:24.993292 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:24.993338 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 23:36:24.993430 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 23:36:24.993596 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15754,"thread_start_us":10946,"threads_started":1}
I20260808 23:36:24.995656 9355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:24.932592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37044 (local address 127.26.207.195:34475)
0808 23:36:24.941465 (+ 8873us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:24.941479 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:24.948800 (+ 7321us) server_negotiation.cc:407] Connection header received
0808 23:36:24.948924 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:24.948931 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:24.950649 (+ 1718us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:24.950891 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:36:24.957094 (+ 6203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.980179 (+ 23085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.983387 (+ 3208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:24.992531 (+ 9144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:24.994787 (+ 2256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:24.995008 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:24.995119 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 23:36:24.995309 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8647,"thread_start_us":8482,"threads_started":1}
I20260808 23:36:25.000372 9263 tablet_service.cc:1467] Processing CreateTablet for tablet 5c24913f45254bdfab00bb30efb17d30 (DEFAULT_TABLE table=test-table [id=8355dbd9982941bf95d7dfc53ec46935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:36:25.004163 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c24913f45254bdfab00bb30efb17d30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:36:25.005658 9356 tablet_bootstrap.cc:492] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f: Bootstrap starting.
I20260808 23:36:25.010039 9356 tablet_bootstrap.cc:654] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f: Neither blocks nor log segments found. Creating new log.
I20260808 23:36:25.012858 9356 log.cc:824] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:25.015096 9188 heartbeater.cc:503] Master 127.26.207.254:41121 was elected leader, sending a full tablet report...
I20260808 23:36:25.037987 9358 tablet_bootstrap.cc:492] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78: Bootstrap starting.
I20260808 23:36:25.043998 9358 tablet_bootstrap.cc:654] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78: Neither blocks nor log segments found. Creating new log.
I20260808 23:36:25.052438 9358 log.cc:824] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:25.056409 9356 tablet_bootstrap.cc:492] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f: No bootstrap required, opened a new log
I20260808 23:36:25.056892 9356 ts_tablet_manager.cc:1397] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f: Time spent bootstrapping tablet: real 0.052s user 0.030s sys 0.019s
I20260808 23:36:25.062119 9359 tablet_bootstrap.cc:492] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350: Bootstrap starting.
I20260808 23:36:25.066576 9359 tablet_bootstrap.cc:654] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350: Neither blocks nor log segments found. Creating new log.
I20260808 23:36:25.068619 9359 log.cc:824] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:25.069305 9358 tablet_bootstrap.cc:492] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78: No bootstrap required, opened a new log
I20260808 23:36:25.069722 9358 ts_tablet_manager.cc:1397] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78: Time spent bootstrapping tablet: real 0.032s user 0.015s sys 0.000s
I20260808 23:36:25.069518 9356 raft_consensus.cc:348] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfe8a52f9cee4d5b903d433c81dfed78" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44699 } } peers { permanent_uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 32935 } } peers { permanent_uuid: "fda2a84342184cefb7fd8cdc45181350" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34475 } }
I20260808 23:36:25.070191 9356 raft_consensus.cc:374] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:36:25.070350 9356 raft_consensus.cc:729] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 374302c2a54a4bf8b1dcbd24cfba5e4f, State: Initialized, Role: FOLLOWER
I20260808 23:36:25.071427 9356 consensus_queue.cc:260] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfe8a52f9cee4d5b903d433c81dfed78" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44699 } } peers { permanent_uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 32935 } } peers { permanent_uuid: "fda2a84342184cefb7fd8cdc45181350" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34475 } }
I20260808 23:36:25.102771 9356 ts_tablet_manager.cc:1428] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f: Time spent starting tablet: real 0.046s user 0.030s sys 0.013s
I20260808 23:36:25.102500 9358 raft_consensus.cc:348] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfe8a52f9cee4d5b903d433c81dfed78" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44699 } } peers { permanent_uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 32935 } } peers { permanent_uuid: "fda2a84342184cefb7fd8cdc45181350" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34475 } }
I20260808 23:36:25.103147 9358 raft_consensus.cc:374] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:36:25.103278 9358 raft_consensus.cc:729] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfe8a52f9cee4d5b903d433c81dfed78, State: Initialized, Role: FOLLOWER
I20260808 23:36:25.104224 9359 tablet_bootstrap.cc:492] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350: No bootstrap required, opened a new log
I20260808 23:36:25.104050 9358 consensus_queue.cc:260] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfe8a52f9cee4d5b903d433c81dfed78" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44699 } } peers { permanent_uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 32935 } } peers { permanent_uuid: "fda2a84342184cefb7fd8cdc45181350" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34475 } }
I20260808 23:36:25.104686 9359 ts_tablet_manager.cc:1397] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350: Time spent bootstrapping tablet: real 0.051s user 0.023s sys 0.017s
I20260808 23:36:25.113278 9358 ts_tablet_manager.cc:1428] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78: Time spent starting tablet: real 0.043s user 0.015s sys 0.010s
I20260808 23:36:25.113775 9024 heartbeater.cc:503] Master 127.26.207.254:41121 was elected leader, sending a full tablet report...
I20260808 23:36:25.116430 9359 raft_consensus.cc:348] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfe8a52f9cee4d5b903d433c81dfed78" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44699 } } peers { permanent_uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 32935 } } peers { permanent_uuid: "fda2a84342184cefb7fd8cdc45181350" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34475 } }
I20260808 23:36:25.117151 9359 raft_consensus.cc:374] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:36:25.117327 9359 raft_consensus.cc:729] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fda2a84342184cefb7fd8cdc45181350, State: Initialized, Role: FOLLOWER
I20260808 23:36:25.118234 9359 consensus_queue.cc:260] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfe8a52f9cee4d5b903d433c81dfed78" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44699 } } peers { permanent_uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 32935 } } peers { permanent_uuid: "fda2a84342184cefb7fd8cdc45181350" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34475 } }
I20260808 23:36:25.120484 9332 heartbeater.cc:503] Master 127.26.207.254:41121 was elected leader, sending a full tablet report...
I20260808 23:36:25.121515 9359 ts_tablet_manager.cc:1428] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350: Time spent starting tablet: real 0.017s user 0.011s sys 0.004s
I20260808 23:36:25.170542 9366 raft_consensus.cc:482] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:36:25.170997 9366 raft_consensus.cc:504] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfe8a52f9cee4d5b903d433c81dfed78" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44699 } } peers { permanent_uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 32935 } } peers { permanent_uuid: "fda2a84342184cefb7fd8cdc45181350" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34475 } }
I20260808 23:36:25.173213 9366 leader_election.cc:288] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfe8a52f9cee4d5b903d433c81dfed78 (127.26.207.193:44699), 374302c2a54a4bf8b1dcbd24cfba5e4f (127.26.207.194:32935)
I20260808 23:36:25.181084 9335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:25.173644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:44699 (local address 127.26.207.195:49977)
0808 23:36:25.173991 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:25.174013 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:25.174185 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:25.174853 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:25.174865 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:25.174898 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:36:25.175132 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:25.175151 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:25.176569 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:25.176576 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:25.178439 (+ 1863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:25.178455 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:25.180259 (+ 1804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:25.180264 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:25.180454 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:25.180486 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 23:36:25.180608 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 23:36:25.180760 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":1}
I20260808 23:36:25.181082 9351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:25.173771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:49977 (local address 127.26.207.193:44699)
0808 23:36:25.173981 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:25.173988 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:25.174321 (+ 333us) server_negotiation.cc:407] Connection header received
0808 23:36:25.174432 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:25.174440 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:25.174527 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:25.174623 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:36:25.175361 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:25.176425 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:25.178690 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:25.180010 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:25.180241 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:25.180335 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:25.180640 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 23:36:25.180809 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 23:36:25.182413 8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c24913f45254bdfab00bb30efb17d30" candidate_uuid: "fda2a84342184cefb7fd8cdc45181350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfe8a52f9cee4d5b903d433c81dfed78" is_pre_election: true
I20260808 23:36:25.182783 9353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:25.174362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:39771 (local address 127.26.207.194:32935)
0808 23:36:25.174593 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:25.174601 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:25.175281 (+ 680us) server_negotiation.cc:407] Connection header received
0808 23:36:25.175436 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:25.175444 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:25.175561 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:25.175670 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:36:25.176323 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:25.177519 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:25.180141 (+ 2622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:25.181450 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:25.181627 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:25.181703 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:25.182312 (+ 609us) server_negotiation.cc:299] Negotiation successful
0808 23:36:25.182487 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 23:36:25.182806 9374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:25.173752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:32935 (local address 127.26.207.195:39771)
0808 23:36:25.175152 (+ 1400us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:25.175171 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:25.175301 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:25.175717 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:25.175721 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:25.175751 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:36:25.176120 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:25.176133 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:25.177712 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:25.177718 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:25.179915 (+ 2197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:25.179934 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:25.181883 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:25.181890 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:25.182090 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:25.182131 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 23:36:25.182246 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 23:36:25.182396 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1267,"thread_start_us":1017,"threads_started":1}
I20260808 23:36:25.183148 8975 raft_consensus.cc:2454] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fda2a84342184cefb7fd8cdc45181350 in term 0.
I20260808 23:36:25.184098 9212 leader_election.cc:302] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfe8a52f9cee4d5b903d433c81dfed78, fda2a84342184cefb7fd8cdc45181350; no voters:
I20260808 23:36:25.184234 9139 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c24913f45254bdfab00bb30efb17d30" candidate_uuid: "fda2a84342184cefb7fd8cdc45181350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f" is_pre_election: true
I20260808 23:36:25.184576 9366 raft_consensus.cc:2781] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:36:25.184741 9366 raft_consensus.cc:482] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:36:25.184885 9366 raft_consensus.cc:3037] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:36:25.184921 9139 raft_consensus.cc:2454] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fda2a84342184cefb7fd8cdc45181350 in term 0.
I20260808 23:36:25.187786 9366 raft_consensus.cc:504] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfe8a52f9cee4d5b903d433c81dfed78" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44699 } } peers { permanent_uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 32935 } } peers { permanent_uuid: "fda2a84342184cefb7fd8cdc45181350" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34475 } }
I20260808 23:36:25.188537 9366 leader_election.cc:288] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [CANDIDATE]: Term 1 election: Requested vote from peers bfe8a52f9cee4d5b903d433c81dfed78 (127.26.207.193:44699), 374302c2a54a4bf8b1dcbd24cfba5e4f (127.26.207.194:32935)
I20260808 23:36:25.189172 8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c24913f45254bdfab00bb30efb17d30" candidate_uuid: "fda2a84342184cefb7fd8cdc45181350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfe8a52f9cee4d5b903d433c81dfed78"
I20260808 23:36:25.189226 9139 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c24913f45254bdfab00bb30efb17d30" candidate_uuid: "fda2a84342184cefb7fd8cdc45181350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f"
I20260808 23:36:25.189445 9139 raft_consensus.cc:3037] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:36:25.189445 8975 raft_consensus.cc:3037] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:36:25.193117 8975 raft_consensus.cc:2454] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda2a84342184cefb7fd8cdc45181350 in term 1.
I20260808 23:36:25.193117 9139 raft_consensus.cc:2454] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fda2a84342184cefb7fd8cdc45181350 in term 1.
I20260808 23:36:25.193708 9213 leader_election.cc:302] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 374302c2a54a4bf8b1dcbd24cfba5e4f, fda2a84342184cefb7fd8cdc45181350; no voters:
I20260808 23:36:25.194532 9366 raft_consensus.cc:2781] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:36:25.195154 9366 raft_consensus.cc:686] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [term 1 LEADER]: Becoming Leader. State: Replica: fda2a84342184cefb7fd8cdc45181350, State: Running, Role: LEADER
I20260808 23:36:25.195739 9366 consensus_queue.cc:237] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfe8a52f9cee4d5b903d433c81dfed78" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44699 } } peers { permanent_uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 32935 } } peers { permanent_uuid: "fda2a84342184cefb7fd8cdc45181350" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34475 } }
I20260808 23:36:25.201627 8803 catalog_manager.cc:5495] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 reported cstate change: term changed from 0 to 1, leader changed from <none> to fda2a84342184cefb7fd8cdc45181350 (127.26.207.195). New cstate: current_term: 1 leader_uuid: "fda2a84342184cefb7fd8cdc45181350" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfe8a52f9cee4d5b903d433c81dfed78" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 32935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fda2a84342184cefb7fd8cdc45181350" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34475 } health_report { overall_health: HEALTHY } } }
W20260808 23:36:25.223361 9189 tablet.cc:2369] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:36:25.227927 9025 tablet.cc:2369] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:36:25.239046 9333 tablet.cc:2369] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:36:25.269076 9355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:25.260293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37054 (local address 127.26.207.195:34475)
0808 23:36:25.260503 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:25.260507 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:25.260527 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:36:25.260827 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:25.260836 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:25.260960 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:25.261131 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:36:25.261646 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:25.262372 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:25.265687 (+ 3315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:25.266532 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:25.266699 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:25.267470 (+ 771us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:36:25.268315 (+ 845us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:36:25.268472 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:25.268631 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 23:36:25.268712 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 23:36:25.279125 9139 raft_consensus.cc:1261] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f [term 1 FOLLOWER]: Refusing update from remote peer fda2a84342184cefb7fd8cdc45181350: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:36:25.279410 8975 raft_consensus.cc:1261] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78 [term 1 FOLLOWER]: Refusing update from remote peer fda2a84342184cefb7fd8cdc45181350: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:36:25.280395 9366 consensus_queue.cc:1035] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "374302c2a54a4bf8b1dcbd24cfba5e4f" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 32935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:36:25.280848 9375 consensus_queue.cc:1035] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfe8a52f9cee4d5b903d433c81dfed78" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 44699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:36:25.302577 9378 mvcc.cc:205] Tried to move back new op lower bound from 7316407030891085824 to 7316407030566957056. Current Snapshot: MvccSnapshot[applied={T|T < 7316407030891085824}]
I20260808 23:36:25.322458 8802 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:36:25.322970 8802 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:36:25.329430 8802 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 91e33bcb2f2147b08575ebcd0374eba1: Sending DeleteTablet for 3 replicas of tablet 5c24913f45254bdfab00bb30efb17d30
I20260808 23:36:25.331382 8949 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c24913f45254bdfab00bb30efb17d30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:36:25 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:42574
I20260808 23:36:25.331568 9116 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c24913f45254bdfab00bb30efb17d30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:36:25 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:50760
I20260808 23:36:25.332293 9263 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c24913f45254bdfab00bb30efb17d30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:36:25 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:37044
I20260808 23:36:25.332454 9388 tablet_replica.cc:330] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78: stopping tablet replica
I20260808 23:36:25.333014 8948 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c24913f45254bdfab00bb30efb17d30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:36:25 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:42574
I20260808 23:36:25.333014 9388 raft_consensus.cc:2229] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:36:25.333770 9388 raft_consensus.cc:2258] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:36:25.336005 9388 ts_tablet_manager.cc:1905] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:36:25.336450 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 8843
I20260808 23:36:25.346340 9388 ts_tablet_manager.cc:1918] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:36:25.346737 9388 log.cc:1196] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/5c24913f45254bdfab00bb30efb17d30
I20260808 23:36:25.347551 9388 ts_tablet_manager.cc:1939] T 5c24913f45254bdfab00bb30efb17d30 P bfe8a52f9cee4d5b903d433c81dfed78: Deleting consensus metadata
I20260808 23:36:25.350238 8786 catalog_manager.cc:4841] TS bfe8a52f9cee4d5b903d433c81dfed78 (127.26.207.193:44699): tablet 5c24913f45254bdfab00bb30efb17d30 (table test-table [id=8355dbd9982941bf95d7dfc53ec46935]) successfully deleted
W20260808 23:36:25.351807 8786 catalog_manager.cc:4808] TS bfe8a52f9cee4d5b903d433c81dfed78 (127.26.207.193:44699): delete failed for tablet 5c24913f45254bdfab00bb30efb17d30 because the tablet was not found. No further retry: Not found: Tablet not found: 5c24913f45254bdfab00bb30efb17d30
I20260808 23:36:25.353754 9390 tablet_replica.cc:330] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350: stopping tablet replica
I20260808 23:36:25.354964 9390 raft_consensus.cc:2229] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:36:25.355902 9390 raft_consensus.cc:2258] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:36:25.357044 9389 tablet_replica.cc:330] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f: stopping tablet replica
I20260808 23:36:25.357625 9389 raft_consensus.cc:2229] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:36:25.358378 9389 raft_consensus.cc:2258] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:36:25.358649 9390 ts_tablet_manager.cc:1905] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:36:25.360927 9389 ts_tablet_manager.cc:1905] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:36:25.367327 9390 ts_tablet_manager.cc:1918] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:36:25.369470 9389 ts_tablet_manager.cc:1918] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:36:25.369575 9390 log.cc:1196] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/5c24913f45254bdfab00bb30efb17d30
I20260808 23:36:25.369957 9389 log.cc:1196] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/5c24913f45254bdfab00bb30efb17d30
I20260808 23:36:25.370343 9390 ts_tablet_manager.cc:1939] T 5c24913f45254bdfab00bb30efb17d30 P fda2a84342184cefb7fd8cdc45181350: Deleting consensus metadata
I20260808 23:36:25.370743 9389 ts_tablet_manager.cc:1939] T 5c24913f45254bdfab00bb30efb17d30 P 374302c2a54a4bf8b1dcbd24cfba5e4f: Deleting consensus metadata
I20260808 23:36:25.373409 8787 catalog_manager.cc:4841] TS 374302c2a54a4bf8b1dcbd24cfba5e4f (127.26.207.194:32935): tablet 5c24913f45254bdfab00bb30efb17d30 (table test-table [id=8355dbd9982941bf95d7dfc53ec46935]) successfully deleted
I20260808 23:36:25.374831 8784 catalog_manager.cc:4841] TS fda2a84342184cefb7fd8cdc45181350 (127.26.207.195:34475): tablet 5c24913f45254bdfab00bb30efb17d30 (table test-table [id=8355dbd9982941bf95d7dfc53ec46935]) successfully deleted
I20260808 23:36:25.377820 9351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:25.337936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42588 (local address 127.26.207.193:44699)
0808 23:36:25.338131 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:25.338140 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:25.354616 (+ 16476us) server_negotiation.cc:407] Connection header received
0808 23:36:25.354944 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:25.354952 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:25.355054 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:25.355150 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:25.357713 (+ 2563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:25.359209 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:25.361445 (+ 2236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:25.362267 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:25.362409 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:25.367046 (+ 4637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:25.367071 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:25.367093 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:25.367146 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:25.372980 (+ 5834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:25.374519 (+ 1539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:25.374541 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:25.374546 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:25.374808 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:25.375528 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:25.375534 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:25.375537 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:25.376113 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:25.376511 (+ 398us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:25.376930 (+ 419us) server_negotiation.cc:299] Negotiation successful
0808 23:36:25.377226 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 23:36:25.379129 9019 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:25.530499 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 8843
I20260808 23:36:25.554868 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 9029
I20260808 23:36:25.573729 9353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:25.555844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50776 (local address 127.26.207.194:32935)
0808 23:36:25.556081 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:25.556088 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:25.556115 (+ 27us) server_negotiation.cc:407] Connection header received
0808 23:36:25.556246 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:25.556252 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:25.556348 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:25.556468 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:25.558081 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:25.559295 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:25.561026 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:25.561697 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:25.561848 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:25.564817 (+ 2969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:25.564842 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:25.564865 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:25.564926 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:25.569542 (+ 4616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:25.570763 (+ 1221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:25.570775 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:25.570779 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:25.571077 (+ 298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:25.571809 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:25.571816 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:25.571820 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:25.572277 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:25.572672 (+ 395us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:25.573066 (+ 394us) server_negotiation.cc:299] Negotiation successful
0808 23:36:25.573323 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 23:36:25.574512 9183 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:25.672631 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 9029
I20260808 23:36:25.704556 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 9193
I20260808 23:36:25.725445 9355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:25.705475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37066 (local address 127.26.207.195:34475)
0808 23:36:25.705683 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:25.705689 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:25.705739 (+ 50us) server_negotiation.cc:407] Connection header received
0808 23:36:25.705967 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:25.705978 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:25.706094 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:25.706229 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:25.708095 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:25.709460 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:25.711476 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:25.712235 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:25.712484 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:25.716107 (+ 3623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:25.716125 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:25.716145 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:25.716207 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:25.721556 (+ 5349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:25.722664 (+ 1108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:25.722675 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:25.722679 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:25.722922 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:25.723426 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:25.723432 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:25.723441 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:25.723984 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:25.724356 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:25.724693 (+ 337us) server_negotiation.cc:299] Negotiation successful
0808 23:36:25.724998 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 23:36:25.726366 9327 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:25.854683 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 9193
I20260808 23:36:25.880435 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 8766
I20260808 23:36:25.881870 8835 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:26.007342 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 8766
I20260808 23:36:26.040870 27455 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 23:36:26.387437 27455 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 23:36:26.387706 27455 mini_ranger.cc:66] Stopping Ranger...
I20260808 23:36:26.734570 27455 mini_ranger.cc:68] Stopped Ranger
2026-08-08 23:36:26.735 UTC [7699] LOG: received smart shutdown request
2026-08-08 23:36:26.738 UTC [7699] LOG: background worker "logical replication launcher" (PID 7709) exited with exit code 1
2026-08-08 23:36:26.739 UTC [7703] LOG: shutting down
2026-08-08 23:36:26.932 UTC [7699] LOG: database system is shut down
2026-08-08T23:36:26Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (57333 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:36:27 dist-test-slave-1x4g krb5kdc[9404](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:36:27 dist-test-slave-1x4g krb5kdc[9404](info): set up 2 sockets
Aug 08 23:36:27 dist-test-slave-1x4g krb5kdc[9404](info): commencing operation
krb5kdc: starting...
W20260808 23:36:28.246838 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.006s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:36:28 dist-test-slave-1x4g krb5kdc[9404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:36:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:36:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:36:28.569700 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:35371
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:35371,127.26.207.253:38549,127.26.207.252:44291
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:36:28.947549 9423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:28.947896 9423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:28.948076 9423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:28.955770 9423 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:36:28.955924 9423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:28.955976 9423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:28.956112 9423 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:36:28.956187 9423 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:36:28.967041 9423 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:35371,127.26.207.253:38549,127.26.207.252:44291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:35371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:28.968639 9423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:28.970152 9423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:28.983902 9428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:28.983836 9429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:28.983819 9433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:28.985194 9423 server_base.cc:1034] running on GCE node
I20260808 23:36:28.986163 9423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:28.987840 9423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:28.989102 9423 hybrid_clock.cc:648] HybridClock initialized: now 1786232188989053 us; error 67 us; skew 500 ppm
I20260808 23:36:28.989511 9423 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:28 dist-test-slave-1x4g krb5kdc[9404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232188, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:28.998673 9423 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:36:29.000840 9423 webserver.cc:460] Webserver started at http://127.26.207.254:36173/ using document root <none> and password file <none>
I20260808 23:36:29.001696 9423 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:29.001865 9423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:29.002220 9423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:36:29.005800 9423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "7265efa0160e449c8e77c545358b7876"
format_stamp: "Formatted at 2026-08-08 23:36:28 on dist-test-slave-1x4g"
server_key: "828cbd0c169086ba9f95de679d1a864e"
server_key_iv: "a797238ba67c0ee2c15ba0ba4b3b7822"
server_key_version: "encryptionkey@0"
I20260808 23:36:29.006758 9423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "7265efa0160e449c8e77c545358b7876"
format_stamp: "Formatted at 2026-08-08 23:36:28 on dist-test-slave-1x4g"
server_key: "828cbd0c169086ba9f95de679d1a864e"
server_key_iv: "a797238ba67c0ee2c15ba0ba4b3b7822"
server_key_version: "encryptionkey@0"
I20260808 23:36:29.012966 9423 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 23:36:29.017202 9443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:29.018790 9423 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:36:29.019049 9423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "7265efa0160e449c8e77c545358b7876"
format_stamp: "Formatted at 2026-08-08 23:36:28 on dist-test-slave-1x4g"
server_key: "828cbd0c169086ba9f95de679d1a864e"
server_key_iv: "a797238ba67c0ee2c15ba0ba4b3b7822"
server_key_version: "encryptionkey@0"
I20260808 23:36:29.019299 9423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:29.036141 9423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:29.041071 9423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:29.041414 9423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:29.063714 9423 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:35371
I20260808 23:36:29.063774 9502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:35371 every 8 connection(s)
I20260808 23:36:29.065384 9423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:36:29.069640 9503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:36:29.072499 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 9423
I20260808 23:36:29.072803 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:36:29.073711 27455 external_mini_cluster.cc:1428] Setting key a8a697263cbaac90b5bff44db730ac64
I20260808 23:36:29.080485 9503 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:36:29 dist-test-slave-1x4g krb5kdc[9404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232188, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.207.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.253@KRBTEST.COM" created.
I20260808 23:36:29.110534 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.085339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:35371 (local address 127.0.0.1:54508)
0808 23:36:29.086482 (+ 1143us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.086546 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:29.089391 (+ 2845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:29.090709 (+ 1318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:29.090716 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:29.091421 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:29.091838 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:29.091894 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:29.094804 (+ 2910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:29.094810 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:29.096197 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:29.096216 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:29.097904 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:29.097910 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:29.098059 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:29.098829 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:29.098856 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:29.101470 (+ 2614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:29.105230 (+ 3760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:29.105244 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:29.105259 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:29.105815 (+ 556us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:29.106329 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:29.106334 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:29.106338 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:29.106570 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:29.107440 (+ 870us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:29.107448 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:29.107720 (+ 272us) client_negotiation.cc:769] Sending connection context
0808 23:36:29.108013 (+ 293us) client_negotiation.cc:240] Negotiation successful
0808 23:36:29.108942 (+ 929us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":788,"mutex_wait_us":288,"thread_start_us":476,"threads_started":1}
I20260808 23:36:29.110556 9506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.085339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54508 (local address 127.26.207.254:35371)
0808 23:36:29.087690 (+ 2351us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:29.087697 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:29.087747 (+ 50us) server_negotiation.cc:407] Connection header received
0808 23:36:29.089926 (+ 2179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:29.089939 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:29.090359 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:29.090638 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:29.092144 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:29.094530 (+ 2386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:29.096416 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:29.097606 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:29.097857 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:29.101757 (+ 3900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:29.101767 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:29.101783 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:29.101821 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:29.105050 (+ 3229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:29.105989 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:29.105999 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:29.106001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:29.106188 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:29.106681 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:29.106687 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:29.106690 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:29.107281 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:29.107523 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:29.108106 (+ 583us) server_negotiation.cc:299] Negotiation successful
0808 23:36:29.108804 (+ 698us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":2112,"spinlock_wait_cycles":32512,"thread_start_us":1820,"threads_started":1}
I20260808 23:36:29.115552 9503 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } has no permanent_uuid. Determining permanent_uuid...
I20260808 23:36:29.116973 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.116413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38549 (local address 127.0.0.1:40120)
0808 23:36:29.116629 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.116767 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260808 23:36:29.117301 9444 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38549: connect: Connection refused (error 111)
I20260808 23:36:29.119104 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.118697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38549 (local address 127.0.0.1:40126)
0808 23:36:29.118894 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.118966 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 23:36:29.119343 9503 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.253:38549: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38549: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.253.keytab.
Entry for principal kudu/127.26.207.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.253.keytab.
I20260808 23:36:29.146675 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.253:38549
--webserver_interface=127.26.207.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.253.keytab
--principal=kudu/127.26.207.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:35371,127.26.207.253:38549,127.26.207.252:44291
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:36:29.168853 9503 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } attempt: 1
I20260808 23:36:29.170311 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.169625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38549 (local address 127.0.0.1:40142)
0808 23:36:29.169918 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.170090 (+ 172us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260808 23:36:29.171622 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.171109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38549 (local address 127.0.0.1:40144)
0808 23:36:29.171309 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.171426 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 23:36:29.171867 9503 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.253:38549: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38549: connect: Connection refused (error 111)
I20260808 23:36:29.240204 9503 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } attempt: 2
I20260808 23:36:29.241737 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.241101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38549 (local address 127.0.0.1:40148)
0808 23:36:29.241419 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.241554 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260808 23:36:29.242884 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.242440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38549 (local address 127.0.0.1:40152)
0808 23:36:29.242610 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.242716 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 23:36:29.243141 9503 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.253:38549: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38549: connect: Connection refused (error 111)
I20260808 23:36:29.334438 9503 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } attempt: 3
I20260808 23:36:29.335826 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.335256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38549 (local address 127.0.0.1:40166)
0808 23:36:29.335511 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.335650 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260808 23:36:29.337167 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.336666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38549 (local address 127.0.0.1:40168)
0808 23:36:29.336876 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.336975 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260808 23:36:29.337427 9503 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.253:38549: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38549: connect: Connection refused (error 111)
I20260808 23:36:29.480754 9503 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } attempt: 4
I20260808 23:36:29.482311 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.481590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38549 (local address 127.0.0.1:51608)
0808 23:36:29.481986 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.482113 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213}
I20260808 23:36:29.483723 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.483157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38549 (local address 127.0.0.1:51612)
0808 23:36:29.483379 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.483505 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260808 23:36:29.484038 9503 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.253:38549: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38549: connect: Connection refused (error 111)
W20260808 23:36:29.518962 9510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:29.519315 9510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:29.519409 9510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:29.527630 9510 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:36:29.527768 9510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:29.527818 9510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:29.527879 9510 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:36:29.527925 9510 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:36:29.538743 9510 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:35371,127.26.207.253:38549,127.26.207.252:44291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.253.keytab
--principal=kudu/127.26.207.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.253:38549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.207.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:29.540194 9510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:29.541697 9510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:29.555451 9516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:29.555469 9515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:29.556344 9519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:29.556654 9510 server_base.cc:1034] running on GCE node
I20260808 23:36:29.557638 9510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:29.559264 9510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:29.560532 9510 hybrid_clock.cc:648] HybridClock initialized: now 1786232189560478 us; error 60 us; skew 500 ppm
I20260808 23:36:29.560997 9510 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:29 dist-test-slave-1x4g krb5kdc[9404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232189, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:29.564745 9510 init.cc:377] Logged in from keytab as kudu/127.26.207.253@KRBTEST.COM (short username kudu)
I20260808 23:36:29.566732 9510 webserver.cc:460] Webserver started at http://127.26.207.253:39955/ using document root <none> and password file <none>
I20260808 23:36:29.567590 9510 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:29.567762 9510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:29.568135 9510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:36:29.571944 9510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/data/instance:
uuid: "2431e2931b7749cab84c8abf9a5856d6"
format_stamp: "Formatted at 2026-08-08 23:36:29 on dist-test-slave-1x4g"
server_key: "fda24d1cff3981f7e16a48821eb18494"
server_key_iv: "5266da90e2efbddceb287044df348be9"
server_key_version: "encryptionkey@0"
I20260808 23:36:29.573087 9510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/wal/instance:
uuid: "2431e2931b7749cab84c8abf9a5856d6"
format_stamp: "Formatted at 2026-08-08 23:36:29 on dist-test-slave-1x4g"
server_key: "fda24d1cff3981f7e16a48821eb18494"
server_key_iv: "5266da90e2efbddceb287044df348be9"
server_key_version: "encryptionkey@0"
I20260808 23:36:29.579514 9510 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260808 23:36:29.583743 9526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:29.585688 9510 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:36:29.585934 9510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/wal
uuid: "2431e2931b7749cab84c8abf9a5856d6"
format_stamp: "Formatted at 2026-08-08 23:36:29 on dist-test-slave-1x4g"
server_key: "fda24d1cff3981f7e16a48821eb18494"
server_key_iv: "5266da90e2efbddceb287044df348be9"
server_key_version: "encryptionkey@0"
I20260808 23:36:29.586186 9510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:29.622639 9510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:29.627863 9510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:29.628223 9510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:29.649082 9510 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.253:38549
I20260808 23:36:29.649115 9585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.253:38549 every 8 connection(s)
I20260808 23:36:29.650712 9510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/data/info.pb
I20260808 23:36:29.654896 9586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:36:29.659997 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 9510
I20260808 23:36:29.660234 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-1/wal/instance
I20260808 23:36:29.660722 27455 external_mini_cluster.cc:1428] Setting key d7886736d513abddcb4062a8349baebe
I20260808 23:36:29.662377 9586 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:36:29 dist-test-slave-1x4g krb5kdc[9404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232189, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.253@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:36:29.686395 9590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.665496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37656 (local address 127.26.207.254:35371)
0808 23:36:29.666090 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:29.666094 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:29.667482 (+ 1388us) server_negotiation.cc:407] Connection header received
0808 23:36:29.669907 (+ 2425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:29.669912 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:29.670024 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:29.670167 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:29.672146 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:29.673000 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:29.674713 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:29.675170 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:29.675325 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:29.679703 (+ 4378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:29.679709 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:29.679712 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:29.679764 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:29.682745 (+ 2981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:29.683686 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:29.683696 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:29.683698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:29.683843 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:29.684342 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:29.684347 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:29.684351 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:29.684673 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:29.684874 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:29.685728 (+ 854us) server_negotiation.cc:299] Negotiation successful
0808 23:36:29.686009 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":298,"threads_started":1}
I20260808 23:36:29.687518 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.666292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:35371 (local address 127.0.0.1:37656)
0808 23:36:29.667282 (+ 990us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.667329 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:29.669534 (+ 2205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:29.670457 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:29.670466 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:29.671161 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:29.671877 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:29.671902 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:29.673191 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:29.673195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:29.674532 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:29.674546 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:29.675450 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:29.675458 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:29.675708 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:29.676535 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:29.676559 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:29.679379 (+ 2820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:29.682945 (+ 3566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:29.682957 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:29.682982 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:29.683523 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:29.683986 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:29.683991 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:29.683995 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:29.684210 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:29.684856 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:29.684865 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:29.685298 (+ 433us) client_negotiation.cc:769] Sending connection context
0808 23:36:29.685622 (+ 324us) client_negotiation.cc:240] Negotiation successful
0808 23:36:29.686221 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"thread_start_us":428,"threads_started":1}
I20260808 23:36:29.689592 9586 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.207.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.252@KRBTEST.COM" created.
Aug 08 23:36:29 dist-test-slave-1x4g krb5kdc[9404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232189, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.253@KRBTEST.COM for kudu/127.26.207.253@KRBTEST.COM
I20260808 23:36:29.709360 9593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.690804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51626 (local address 127.26.207.253:38549)
0808 23:36:29.691546 (+ 742us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:29.691552 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:29.691581 (+ 29us) server_negotiation.cc:407] Connection header received
0808 23:36:29.691632 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:29.691639 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:29.691925 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:29.692055 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:29.692906 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:29.694418 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:29.696430 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:29.697180 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:29.697293 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:29.702013 (+ 4720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:29.702040 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:29.702060 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:29.702101 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:29.705774 (+ 3673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:29.706625 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:29.706634 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:29.706636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:29.706815 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:29.707363 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:29.707370 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:29.707376 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:29.707975 (+ 599us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:29.708268 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:29.708670 (+ 402us) server_negotiation.cc:299] Negotiation successful
0808 23:36:29.709019 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":569,"thread_start_us":419,"threads_started":1}
I20260808 23:36:29.709470 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.690536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38549 (local address 127.0.0.1:51626)
0808 23:36:29.690786 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.690805 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:29.690913 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:29.692082 (+ 1169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:29.692086 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:29.692540 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:29.692717 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:29.692727 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:29.694605 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:29.694613 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:29.696236 (+ 1623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:29.696258 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:29.697355 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:29.697363 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:29.697652 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:29.698402 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:29.698433 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:29.701699 (+ 3266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:29.705976 (+ 4277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:29.705982 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:29.705987 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:29.706438 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:29.707020 (+ 582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:29.707024 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:29.707027 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:29.707211 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:29.708178 (+ 967us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:29.708182 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:29.708324 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 23:36:29.708481 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 23:36:29.708903 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115}
I20260808 23:36:29.712186 9586 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } has no permanent_uuid. Determining permanent_uuid...
I20260808 23:36:29.713760 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.713069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38114)
0808 23:36:29.713321 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.713519 (+ 198us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260808 23:36:29.714109 9529 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
I20260808 23:36:29.716043 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.715527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38118)
0808 23:36:29.715736 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.715856 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 23:36:29.716354 9586 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:44291: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.252.keytab.
Entry for principal kudu/127.26.207.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.252.keytab.
I20260808 23:36:29.737182 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.252:44291
--webserver_interface=127.26.207.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.252.keytab
--principal=kudu/127.26.207.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:35371,127.26.207.253:38549,127.26.207.252:44291
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:36:29.765770 9586 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } attempt: 1
I20260808 23:36:29.767050 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.766503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38134)
0808 23:36:29.766709 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.766825 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 23:36:29.768218 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.767814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38144)
0808 23:36:29.768007 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.768098 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 23:36:29.768533 9586 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:44291: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
I20260808 23:36:29.783346 9503 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } attempt: 5
Aug 08 23:36:29 dist-test-slave-1x4g krb5kdc[9404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232188, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for kudu/127.26.207.253@KRBTEST.COM
I20260808 23:36:29.799405 9593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.784256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51630 (local address 127.26.207.253:38549)
0808 23:36:29.784442 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:29.784447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:29.784469 (+ 22us) server_negotiation.cc:407] Connection header received
0808 23:36:29.784676 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:29.784680 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:29.784762 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:29.784928 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:29.785971 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:29.786663 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:29.788501 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:29.789090 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:29.789195 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:29.793352 (+ 4157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:29.793359 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:29.793365 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:29.793412 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:29.796410 (+ 2998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:29.797312 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:29.797320 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:29.797328 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:29.797466 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:29.797918 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:29.797922 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:29.797924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:29.798229 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:29.798395 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:29.798790 (+ 395us) server_negotiation.cc:299] Negotiation successful
0808 23:36:29.799076 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 23:36:29.799434 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.784131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38549 (local address 127.0.0.1:51630)
0808 23:36:29.784375 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.784399 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:29.784539 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:29.784977 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:29.784982 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:29.785522 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:29.785748 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:29.785766 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:29.786829 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:29.786835 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:29.788324 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:29.788341 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:29.789259 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:29.789266 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:29.789472 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:29.790271 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:29.790295 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:29.793104 (+ 2809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:29.796630 (+ 3526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:29.796636 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:29.796640 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:29.797166 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:29.797605 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:29.797610 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:29.797614 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:29.797776 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:29.798358 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:29.798363 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:29.798533 (+ 170us) client_negotiation.cc:769] Sending connection context
0808 23:36:29.798684 (+ 151us) client_negotiation.cc:240] Negotiation successful
0808 23:36:29.799059 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 23:36:29.800606 9503 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } has no permanent_uuid. Determining permanent_uuid...
I20260808 23:36:29.802003 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.801482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38158)
0808 23:36:29.801701 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.801808 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 23:36:29.803048 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.802683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38168)
0808 23:36:29.802847 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.802929 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 23:36:29.803283 9503 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:44291: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
I20260808 23:36:29.836855 9586 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } attempt: 2
I20260808 23:36:29.838299 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.837765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38174)
0808 23:36:29.838006 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.838116 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260808 23:36:29.839432 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.839043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38182)
0808 23:36:29.839208 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.839294 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 23:36:29.839670 9586 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:44291: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
I20260808 23:36:29.854576 9503 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } attempt: 1
I20260808 23:36:29.855878 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.855362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38186)
0808 23:36:29.855579 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.855704 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 23:36:29.857036 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.856593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38198)
0808 23:36:29.856765 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.856899 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260808 23:36:29.857262 9503 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:44291: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
I20260808 23:36:29.925567 9503 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } attempt: 2
I20260808 23:36:29.927037 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.926454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38212)
0808 23:36:29.926720 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.926828 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 23:36:29.928095 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.927721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38224)
0808 23:36:29.927875 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.927967 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 23:36:29.928305 9503 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:44291: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
I20260808 23:36:29.930904 9586 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } attempt: 3
I20260808 23:36:29.932104 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.931593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38240)
0808 23:36:29.931827 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.931936 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 23:36:29.933388 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:29.932910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38248)
0808 23:36:29.933167 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:29.933253 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
W20260808 23:36:29.933619 9586 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:44291: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
I20260808 23:36:30.034561 9503 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } attempt: 3
I20260808 23:36:30.036020 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.035442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38262)
0808 23:36:30.035695 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:30.035799 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260808 23:36:30.037361 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.036907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38272)
0808 23:36:30.037120 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:30.037217 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
W20260808 23:36:30.037599 9503 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:44291: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
I20260808 23:36:30.076917 9586 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } attempt: 4
I20260808 23:36:30.078704 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.077835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38288)
0808 23:36:30.078157 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:30.078260 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260808 23:36:30.080519 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.079927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38292)
0808 23:36:30.080161 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:30.080351 (+ 190us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
W20260808 23:36:30.080852 9586 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:44291: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
W20260808 23:36:30.123817 9596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:30.124253 9596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:30.124425 9596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:30.132668 9596 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:36:30.132920 9596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:30.133039 9596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:30.133148 9596 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:36:30.133227 9596 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:36:30.144230 9596 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:35371,127.26.207.253:38549,127.26.207.252:44291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.252.keytab
--principal=kudu/127.26.207.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.252:44291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.207.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:30.146026 9596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:30.147663 9596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:30.161296 9601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:30.161429 9602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:30.161394 9605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:30.162458 9596 server_base.cc:1034] running on GCE node
I20260808 23:36:30.163327 9596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:30.165023 9596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:30.166265 9596 hybrid_clock.cc:648] HybridClock initialized: now 1786232190166208 us; error 51 us; skew 500 ppm
I20260808 23:36:30.166702 9596 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:30 dist-test-slave-1x4g krb5kdc[9404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232190, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:30.170431 9596 init.cc:377] Logged in from keytab as kudu/127.26.207.252@KRBTEST.COM (short username kudu)
I20260808 23:36:30.172248 9596 webserver.cc:460] Webserver started at http://127.26.207.252:34093/ using document root <none> and password file <none>
I20260808 23:36:30.173177 9596 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:30.173357 9596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:30.173712 9596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:36:30.177256 9596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/data/instance:
uuid: "41866d1373e94123abee8e716c77073f"
format_stamp: "Formatted at 2026-08-08 23:36:30 on dist-test-slave-1x4g"
server_key: "acecbb492f5540a9ba4196be5b59b0b6"
server_key_iv: "dfc5fd9493b9059020c1e43cc1973650"
server_key_version: "encryptionkey@0"
I20260808 23:36:30.178236 9596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/wal/instance:
uuid: "41866d1373e94123abee8e716c77073f"
format_stamp: "Formatted at 2026-08-08 23:36:30 on dist-test-slave-1x4g"
server_key: "acecbb492f5540a9ba4196be5b59b0b6"
server_key_iv: "dfc5fd9493b9059020c1e43cc1973650"
server_key_version: "encryptionkey@0"
I20260808 23:36:30.184464 9596 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 23:36:30.188505 9612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:30.190240 9596 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:36:30.190486 9596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/wal
uuid: "41866d1373e94123abee8e716c77073f"
format_stamp: "Formatted at 2026-08-08 23:36:30 on dist-test-slave-1x4g"
server_key: "acecbb492f5540a9ba4196be5b59b0b6"
server_key_iv: "dfc5fd9493b9059020c1e43cc1973650"
server_key_version: "encryptionkey@0"
I20260808 23:36:30.190799 9596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:30.206501 9596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:30.211503 9596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:30.211856 9596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:30.214828 9503 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } attempt: 4
I20260808 23:36:30.216279 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.215624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38304)
0808 23:36:30.215949 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:30.216073 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260808 23:36:30.217676 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.217172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38308)
0808 23:36:30.217351 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:30.217457 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 23:36:30.217976 9503 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:44291: Network error: Client connection negotiation failed: client connection to 127.26.207.252:44291: connect: Connection refused (error 111)
I20260808 23:36:30.234169 9596 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.252:44291
I20260808 23:36:30.234191 9667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.252:44291 every 8 connection(s)
I20260808 23:36:30.235846 9596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/data/info.pb
I20260808 23:36:30.239053 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 9596
I20260808 23:36:30.239266 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786231963826981-27455-0/minicluster-data/master-2/wal/instance
I20260808 23:36:30.239885 27455 external_mini_cluster.cc:1428] Setting key 86c69163057f6a83906bbc9471739a9c
I20260808 23:36:30.241070 9668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:36:30.250409 9668 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:36:30 dist-test-slave-1x4g krb5kdc[9404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.252@KRBTEST.COM
Aug 08 23:36:30 dist-test-slave-1x4g krb5kdc[9404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232190, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.252@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:36:30.266598 9671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.242168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38322 (local address 127.26.207.252:44291)
0808 23:36:30.243073 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:30.243087 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:30.243133 (+ 46us) server_negotiation.cc:407] Connection header received
0808 23:36:30.244952 (+ 1819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:30.244981 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:30.245465 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:30.245949 (+ 484us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:30.247700 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.249432 (+ 1732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.251052 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.251920 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.252153 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:30.258077 (+ 5924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:30.258088 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:30.258105 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:30.258155 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:30.261810 (+ 3655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.262716 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.262724 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.262731 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.262933 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.263415 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.263422 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.263425 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.264049 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:30.264372 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:30.264969 (+ 597us) server_negotiation.cc:299] Negotiation successful
0808 23:36:30.265468 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":418,"threads_started":1}
I20260808 23:36:30.270051 9673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.253428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:35371 (local address 127.0.0.1:37668)
0808 23:36:30.254602 (+ 1174us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:30.254738 (+ 136us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:30.254947 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:30.255499 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:30.255505 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:30.256315 (+ 810us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:30.256803 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:30.256825 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.257938 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.257944 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:30.259151 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:30.259167 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.260040 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.260048 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:30.260258 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:30.260962 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:30.260980 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:30.263370 (+ 2390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:30.267042 (+ 3672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:30.267054 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:30.267060 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:30.267566 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:30.268018 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:30.268023 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:30.268027 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:30.268184 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:30.268761 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:30.268770 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:30.269011 (+ 241us) client_negotiation.cc:769] Sending connection context
0808 23:36:30.269218 (+ 207us) client_negotiation.cc:240] Negotiation successful
0808 23:36:30.269594 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":885,"thread_start_us":616,"threads_started":1}
I20260808 23:36:30.270072 9672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.253403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37668 (local address 127.26.207.254:35371)
0808 23:36:30.254060 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:30.254070 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:30.254883 (+ 813us) server_negotiation.cc:407] Connection header received
0808 23:36:30.255123 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:30.255130 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:30.255250 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:30.255394 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:30.257029 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.257746 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.259349 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.259798 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.259995 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:30.263616 (+ 3621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:30.263622 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:30.263626 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:30.263665 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:30.266777 (+ 3112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.267719 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.267726 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.267729 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.267886 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.268306 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.268311 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.268317 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.268616 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:30.268843 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:30.269327 (+ 484us) server_negotiation.cc:299] Negotiation successful
0808 23:36:30.269593 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":287,"threads_started":1}
I20260808 23:36:30.272377 9668 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:36:30 dist-test-slave-1x4g krb5kdc[9404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
Aug 08 23:36:30 dist-test-slave-1x4g krb5kdc[9404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232190, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.252@KRBTEST.COM for kudu/127.26.207.253@KRBTEST.COM
I20260808 23:36:30.287930 9673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.273321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38549 (local address 127.0.0.1:51640)
0808 23:36:30.273721 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:30.273739 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:30.273849 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:30.274214 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:30.274219 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:30.274779 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:30.275009 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:30.275023 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.276068 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.276073 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:30.277363 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:30.277383 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.278176 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.278185 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:30.278436 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:30.279053 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:30.279084 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:30.281955 (+ 2871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:30.285260 (+ 3305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:30.285267 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:30.285271 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:30.285719 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:30.286168 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:30.286173 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:30.286177 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:30.286341 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:30.286892 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:30.286896 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:30.287080 (+ 184us) client_negotiation.cc:769] Sending connection context
0808 23:36:30.287232 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 23:36:30.287559 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 23:36:30.287968 9593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.273353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51640 (local address 127.26.207.253:38549)
0808 23:36:30.273597 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:30.273602 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:30.273829 (+ 227us) server_negotiation.cc:407] Connection header received
0808 23:36:30.273957 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:30.273962 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:30.274046 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:30.274146 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:30.275174 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.275905 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.277548 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.277984 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.278088 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:30.282198 (+ 4110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:30.282203 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:30.282207 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:30.282245 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:30.285085 (+ 2840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.285867 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.285878 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.285880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.286039 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.286463 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.286468 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.286476 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.286766 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:30.286938 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:30.287327 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 23:36:30.287565 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 23:36:30.288627 9672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.270046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37674 (local address 127.26.207.254:35371)
0808 23:36:30.270434 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:30.270440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:30.270463 (+ 23us) server_negotiation.cc:407] Connection header received
0808 23:36:30.271054 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:30.271062 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:30.271179 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:30.271301 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:30.273080 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.274029 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.275807 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.276337 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.276440 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:30.282173 (+ 5733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:30.282179 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:30.282182 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:30.282222 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:30.285373 (+ 3151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.286207 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.286235 (+ 28us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.286238 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.286377 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.286809 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.286814 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.286824 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.287116 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:30.287422 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:30.287744 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 23:36:30.287988 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":804,"threads_started":1}
I20260808 23:36:30.289466 9668 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:36:30 dist-test-slave-1x4g krb5kdc[9404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232190, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.252@KRBTEST.COM for kudu/127.26.207.252@KRBTEST.COM
Aug 08 23:36:30 dist-test-slave-1x4g krb5kdc[9404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.253@KRBTEST.COM
I20260808 23:36:30.304271 9673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.290361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38326)
0808 23:36:30.290545 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:30.290567 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:30.290675 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:30.291091 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:30.291095 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:30.291609 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:30.291750 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:30.291758 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.292763 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.292771 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:30.293696 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:30.293708 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.294424 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.294429 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:30.294625 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:30.295294 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:30.295311 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:30.298348 (+ 3037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:30.301714 (+ 3366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:30.301719 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:30.301723 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:30.302101 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:30.302493 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:30.302498 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:30.302501 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:30.302637 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:30.303164 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:30.303168 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:30.303328 (+ 160us) client_negotiation.cc:769] Sending connection context
0808 23:36:30.303473 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 23:36:30.303799 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 23:36:30.304327 9671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.290633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38326 (local address 127.26.207.252:44291)
0808 23:36:30.290795 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:30.290801 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:30.290820 (+ 19us) server_negotiation.cc:407] Connection header received
0808 23:36:30.290874 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:30.290879 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:30.290958 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:30.291073 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:30.291894 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.292632 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.293839 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.294259 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.294402 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:30.298626 (+ 4224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:30.298632 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:30.298635 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:30.298670 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:30.301561 (+ 2891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.302233 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.302246 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.302248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.302369 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.302743 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.302750 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.302753 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.303047 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:30.303206 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:30.303560 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 23:36:30.303968 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":153,"server-negotiator.queue_time_us":42}
I20260808 23:36:30.307411 9593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.290821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51642 (local address 127.26.207.253:38549)
0808 23:36:30.290983 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:30.290989 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:30.291107 (+ 118us) server_negotiation.cc:407] Connection header received
0808 23:36:30.291291 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:30.291297 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:30.291364 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:30.291464 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:30.292772 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.293528 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.295077 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.295634 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.295767 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:30.301249 (+ 5482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:30.301255 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:30.301258 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:30.301299 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:30.304227 (+ 2928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.305229 (+ 1002us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.305234 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.305236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.305384 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.305882 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.305887 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.305890 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.306279 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:30.306497 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:30.306921 (+ 424us) server_negotiation.cc:299] Negotiation successful
0808 23:36:30.307141 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 23:36:30.310777 9668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f: Bootstrap starting.
I20260808 23:36:30.313133 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:36:30.314771 9668 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f: Neither blocks nor log segments found. Creating new log.
I20260808 23:36:30.316002 9668 log.cc:824] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:30.320056 9668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f: No bootstrap required, opened a new log
I20260808 23:36:30.336560 9668 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } }
I20260808 23:36:30.337507 9668 raft_consensus.cc:374] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:36:30.337749 9668 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41866d1373e94123abee8e716c77073f, State: Initialized, Role: FOLLOWER
I20260808 23:36:30.338811 9668 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } }
I20260808 23:36:30.341768 9672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.318717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37682 (local address 127.26.207.254:35371)
0808 23:36:30.318929 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:30.318937 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:30.320432 (+ 1495us) server_negotiation.cc:407] Connection header received
0808 23:36:30.320718 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:30.320727 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:30.320861 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:30.320943 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:30.323450 (+ 2507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.324585 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.328338 (+ 3753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.329159 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.329291 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:30.334042 (+ 4751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:30.334050 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:30.334056 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:30.334105 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:30.337921 (+ 3816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.338992 (+ 1071us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.339000 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.339004 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.339177 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.339720 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.339725 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.339728 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.340156 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:30.340403 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:30.341066 (+ 663us) server_negotiation.cc:299] Negotiation successful
0808 23:36:30.341353 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 23:36:30.341991 9593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.319244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51646 (local address 127.26.207.253:38549)
0808 23:36:30.320127 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:30.320135 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:30.320159 (+ 24us) server_negotiation.cc:407] Connection header received
0808 23:36:30.320236 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:30.320242 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:30.320326 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:30.322887 (+ 2561us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:30.323075 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.324380 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.326636 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.327324 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.328316 (+ 992us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:30.331899 (+ 3583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:30.331909 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:30.331915 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:30.331980 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:30.336752 (+ 4772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.338001 (+ 1249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.338006 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.338010 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.338226 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.338827 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.338836 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.338841 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.339258 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:30.340861 (+ 1603us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:30.341077 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 23:36:30.341449 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":731}
I20260808 23:36:30.343063 9684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } } }
I20260808 23:36:30.343585 9684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:36:30.344766 9668 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:36:30.355679 9671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.319450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38336 (local address 127.26.207.252:44291)
0808 23:36:30.319682 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:30.319691 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:30.333684 (+ 13993us) server_negotiation.cc:407] Connection header received
0808 23:36:30.333985 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:30.333992 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:30.334094 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:30.334184 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:30.336293 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.337582 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.339920 (+ 2338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.340696 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.340845 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:30.347005 (+ 6160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:30.347018 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:30.347023 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:30.347076 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:30.351214 (+ 4138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.352289 (+ 1075us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.352295 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.352298 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.352511 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.353082 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.353089 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.353092 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.353530 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:30.353916 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:30.354963 (+ 1047us) server_negotiation.cc:299] Negotiation successful
0808 23:36:30.355244 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260808 23:36:30.358526 9697 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 23:36:30.358798 9697 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 23:36:30.353266 9596 master_runner.cc:186] Error getting master registration for 127.26.207.254:35371: OK, instance_id { permanent_uuid: "7265efa0160e449c8e77c545358b7876" instance_seqno: 1786232189057594 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 23:36:30.364164 9596 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 23:36:30.380308 9586 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } attempt: 5
Aug 08 23:36:30 dist-test-slave-1x4g krb5kdc[9404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232189, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.253@KRBTEST.COM for kudu/127.26.207.252@KRBTEST.COM
I20260808 23:36:30.398406 9671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.381603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38338 (local address 127.26.207.252:44291)
0808 23:36:30.382048 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:30.382055 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:30.382074 (+ 19us) server_negotiation.cc:407] Connection header received
0808 23:36:30.382136 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:30.382142 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:30.382264 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:30.382394 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:30.383435 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.384311 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.385879 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.386380 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.386585 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:30.390684 (+ 4099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:30.390691 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:30.390696 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:30.390752 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:30.394602 (+ 3850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.395935 (+ 1333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.395947 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.395954 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.396203 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.396850 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.396854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.396856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.397233 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:30.397362 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:30.397870 (+ 508us) server_negotiation.cc:299] Negotiation successful
0808 23:36:30.398122 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299}
I20260808 23:36:30.398568 9591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.381155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38338)
0808 23:36:30.381622 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:30.381646 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:30.381792 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:30.382434 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:30.382439 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:30.383032 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:30.383273 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:30.383285 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.384478 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.384487 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:30.385679 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:30.385697 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.386600 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.386607 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:30.386887 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:30.387700 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:30.387721 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:30.390338 (+ 2617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:30.394802 (+ 4464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:30.394809 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:30.394813 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:30.395500 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:30.396382 (+ 882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:30.396388 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:30.396392 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:30.396660 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:30.397376 (+ 716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:30.397381 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:30.397592 (+ 211us) client_negotiation.cc:769] Sending connection context
0808 23:36:30.397780 (+ 188us) client_negotiation.cc:240] Negotiation successful
0808 23:36:30.398160 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305}
I20260808 23:36:30.404749 9586 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6: Bootstrap starting.
I20260808 23:36:30.408164 9586 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6: Neither blocks nor log segments found. Creating new log.
I20260808 23:36:30.409402 9586 log.cc:824] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:30.412403 9586 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6: No bootstrap required, opened a new log
I20260808 23:36:30.421133 9586 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } }
I20260808 23:36:30.421590 9586 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:36:30.421738 9586 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2431e2931b7749cab84c8abf9a5856d6, State: Initialized, Role: FOLLOWER
I20260808 23:36:30.422429 9586 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } }
I20260808 23:36:30.423470 9700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } } }
I20260808 23:36:30.423884 9700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:36:30.424767 9586 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 23:36:30.437228 9713 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 23:36:30.437521 9713 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 23:36:30.434581 9510 master_runner.cc:186] Error getting master registration for 127.26.207.254:35371: OK, instance_id { permanent_uuid: "7265efa0160e449c8e77c545358b7876" instance_seqno: 1786232189057594 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 23:36:30.450055 9510 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 23:36:30.464500 9618 tablet.cc:2369] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:36:30.466207 9684 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:36:30.466653 9684 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } }
I20260808 23:36:30.468670 9684 leader_election.cc:288] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7265efa0160e449c8e77c545358b7876 (127.26.207.254:35371), 2431e2931b7749cab84c8abf9a5856d6 (127.26.207.253:38549)
I20260808 23:36:30.469941 9556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "41866d1373e94123abee8e716c77073f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2431e2931b7749cab84c8abf9a5856d6" is_pre_election: true
I20260808 23:36:30.470727 9556 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41866d1373e94123abee8e716c77073f in term 0.
I20260808 23:36:30.471645 9613 leader_election.cc:302] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2431e2931b7749cab84c8abf9a5856d6, 41866d1373e94123abee8e716c77073f; no voters:
I20260808 23:36:30.472208 9684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:36:30.472426 9684 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:36:30.472560 9684 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:36:30.477869 9684 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } }
I20260808 23:36:30.481433 9684 leader_election.cc:288] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [CANDIDATE]: Term 1 election: Requested vote from peers 7265efa0160e449c8e77c545358b7876 (127.26.207.254:35371), 2431e2931b7749cab84c8abf9a5856d6 (127.26.207.253:38549)
I20260808 23:36:30.481587 9556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "41866d1373e94123abee8e716c77073f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2431e2931b7749cab84c8abf9a5856d6"
I20260808 23:36:30.481895 9556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:36:30.485754 9556 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41866d1373e94123abee8e716c77073f in term 1.
I20260808 23:36:30.486377 9613 leader_election.cc:302] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2431e2931b7749cab84c8abf9a5856d6, 41866d1373e94123abee8e716c77073f; no voters:
I20260808 23:36:30.486855 9684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:36:30.487617 9684 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [term 1 LEADER]: Becoming Leader. State: Replica: 41866d1373e94123abee8e716c77073f, State: Running, Role: LEADER
I20260808 23:36:30.488349 9684 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } }
I20260808 23:36:30.492236 9716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41866d1373e94123abee8e716c77073f. Latest consensus state: current_term: 1 leader_uuid: "41866d1373e94123abee8e716c77073f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } } }
I20260808 23:36:30.492821 9716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [sys.catalog]: This master's current role is: LEADER
I20260808 23:36:30.495267 9503 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } attempt: 5
I20260808 23:36:30.504624 9718 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:36:30.507428 9718 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 23:36:30 dist-test-slave-1x4g krb5kdc[9404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232188, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for kudu/127.26.207.252@KRBTEST.COM
I20260808 23:36:30.518863 9556 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6 [term 1 FOLLOWER]: Refusing update from remote peer 41866d1373e94123abee8e716c77073f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:36:30.524492 9716 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:36:30.543320 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.496255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:44291 (local address 127.0.0.1:38350)
0808 23:36:30.496875 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:30.496899 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:30.497064 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:30.500921 (+ 3857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:30.500927 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:30.501577 (+ 650us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:30.501844 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:30.501861 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.503550 (+ 1689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.503557 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:30.505279 (+ 1722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:30.505305 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.506581 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.506588 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:30.506799 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:30.507613 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:30.507638 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:30.510922 (+ 3284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:30.538469 (+ 27547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:30.538477 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:30.538482 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:30.539197 (+ 715us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:30.540093 (+ 896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:30.540099 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:30.540103 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:30.540311 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:30.542053 (+ 1742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:30.542060 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:30.542268 (+ 208us) client_negotiation.cc:769] Sending connection context
0808 23:36:30.542440 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 23:36:30.542818 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434}
I20260808 23:36:30.553423 9671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:30.500005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38350 (local address 127.26.207.252:44291)
0808 23:36:30.500199 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:30.500206 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:30.500226 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:36:30.500288 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:30.500295 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:30.500511 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:30.500663 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:30.502104 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.503318 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.505530 (+ 2212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:30.506368 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:30.506553 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:30.511214 (+ 4661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:30.511222 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:30.511227 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:30.511278 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:30.538137 (+ 26859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.539439 (+ 1302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.539448 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.539452 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.539871 (+ 419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:30.540478 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:30.540526 (+ 48us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:30.540530 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:30.541669 (+ 1139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:30.542175 (+ 506us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:30.546912 (+ 4737us) server_negotiation.cc:299] Negotiation successful
0808 23:36:30.549043 (+ 2131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 23:36:30.557993 9700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41866d1373e94123abee8e716c77073f. Latest consensus state: current_term: 1 leader_uuid: "41866d1373e94123abee8e716c77073f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } } }
I20260808 23:36:30.558447 9700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:36:30.562397 9503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876: Bootstrap starting.
I20260808 23:36:30.567638 9719 mvcc.cc:205] Tried to move back new op lower bound from 7316407052349292544 to 7316407052246122496. Current Snapshot: MvccSnapshot[applied={T|T < 7316407052349292544}]
I20260808 23:36:30.572054 9720 mvcc.cc:205] Tried to move back new op lower bound from 7316407052349292544 to 7316407052246122496. Current Snapshot: MvccSnapshot[applied={T|T < 7316407052349292544}]
I20260808 23:36:30.577558 9700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "41866d1373e94123abee8e716c77073f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } } }
I20260808 23:36:30.577899 9700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:36:30.580835 9503 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876: Neither blocks nor log segments found. Creating new log.
I20260808 23:36:30.583350 9503 log.cc:824] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:30.590180 9684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "41866d1373e94123abee8e716c77073f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } } }
I20260808 23:36:30.591954 9684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [sys.catalog]: This master's current role is: LEADER
I20260808 23:36:30.600382 9718 catalog_manager.cc:1347] Generated new cluster ID: c50ddc338ec943179fb407be78afe1b3
I20260808 23:36:30.600529 9718 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:36:30.602918 9503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876: No bootstrap required, opened a new log
I20260808 23:36:30.628567 9503 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } }
I20260808 23:36:30.629809 9503 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:36:30.630252 9503 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7265efa0160e449c8e77c545358b7876, State: Initialized, Role: FOLLOWER
I20260808 23:36:30.631968 9503 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } }
I20260808 23:36:30.648967 9472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "41866d1373e94123abee8e716c77073f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7265efa0160e449c8e77c545358b7876"
I20260808 23:36:30.649482 9471 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:36:30.652902 9473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "41866d1373e94123abee8e716c77073f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7265efa0160e449c8e77c545358b7876" is_pre_election: true
I20260808 23:36:30.655654 9471 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [term 1 FOLLOWER]: Refusing update from remote peer 41866d1373e94123abee8e716c77073f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:36:30.648607 9727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } } }
I20260808 23:36:30.657290 9684 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:36:30.657639 9727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:36:30.649570 9503 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:36:30.660519 9727 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:36:30.660964 9727 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } }
I20260808 23:36:30.667835 9556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7265efa0160e449c8e77c545358b7876" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2431e2931b7749cab84c8abf9a5856d6" is_pre_election: true
I20260808 23:36:30.670892 9727 leader_election.cc:288] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2431e2931b7749cab84c8abf9a5856d6 (127.26.207.253:38549), 41866d1373e94123abee8e716c77073f (127.26.207.252:44291)
I20260808 23:36:30.682826 9642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7265efa0160e449c8e77c545358b7876" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41866d1373e94123abee8e716c77073f" is_pre_election: true
I20260808 23:36:30.685791 9446 leader_election.cc:302] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7265efa0160e449c8e77c545358b7876; no voters: 2431e2931b7749cab84c8abf9a5856d6, 41866d1373e94123abee8e716c77073f
I20260808 23:36:30.710292 9728 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 23:36:30.711503 9727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41866d1373e94123abee8e716c77073f. Latest consensus state: current_term: 1 leader_uuid: "41866d1373e94123abee8e716c77073f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } } }
I20260808 23:36:30.711894 9727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:36:30.712277 9733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "41866d1373e94123abee8e716c77073f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } } }
I20260808 23:36:30.712661 9733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:36:30.715083 9684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "41866d1373e94123abee8e716c77073f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7265efa0160e449c8e77c545358b7876" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35371 } } peers { permanent_uuid: "2431e2931b7749cab84c8abf9a5856d6" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38549 } } peers { permanent_uuid: "41866d1373e94123abee8e716c77073f" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 44291 } } }
I20260808 23:36:30.715484 9684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f [sys.catalog]: This master's current role is: LEADER
I20260808 23:36:30.718869 9718 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:36:30.727416 9718 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:36:30.762606 9748 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 23:36:30.781558 9718 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 41866d1373e94123abee8e716c77073f: Generated new TSK 0
I20260808 23:36:30.782449 9718 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:36:31.439720 9713 catalog_manager.cc:1259] Loaded cluster ID: c50ddc338ec943179fb407be78afe1b3
I20260808 23:36:31.439839 9713 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6: loading cluster ID for follower catalog manager: success
I20260808 23:36:31.442394 9713 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6: acquiring CA information for follower catalog manager: success
I20260808 23:36:31.444298 9713 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2431e2931b7749cab84c8abf9a5856d6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 23:36:31.767298 9748 catalog_manager.cc:1259] Loaded cluster ID: c50ddc338ec943179fb407be78afe1b3
I20260808 23:36:31.767441 9748 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876: loading cluster ID for follower catalog manager: success
I20260808 23:36:31.770390 9748 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876: acquiring CA information for follower catalog manager: success
I20260808 23:36:31.772692 9748 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7265efa0160e449c8e77c545358b7876: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 23:36:31.880565 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 9423
I20260808 23:36:31.882138 9497 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:31.993152 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 9423
I20260808 23:36:32.017871 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 9510
I20260808 23:36:32.019176 9580 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:32.132378 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 9510
I20260808 23:36:32.158432 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 9596
I20260808 23:36:32.159715 9663 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:32.274049 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 9596
2026-08-08T23:36:32Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5210 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:36:32 dist-test-slave-1x4g krb5kdc[9759](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:36:32 dist-test-slave-1x4g krb5kdc[9759](info): set up 2 sockets
Aug 08 23:36:32 dist-test-slave-1x4g krb5kdc[9759](info): commencing operation
krb5kdc: starting...
W20260808 23:36:33.475018 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:36:33 dist-test-slave-1x4g krb5kdc[9759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232193, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:36:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:36:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:36:33.818075 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:41275
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:45097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:41275
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:36:34.195021 9773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:34.195436 9773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:34.195622 9773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:34.203606 9773 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:36:34.203810 9773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:34.203933 9773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:34.204048 9773 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:36:34.204129 9773 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:36:34.215543 9773 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:45097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:41275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:41275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:34.217130 9773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:34.218629 9773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:34.232175 9779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:34.232201 9778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:34.232275 9782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:34.233227 9773 server_base.cc:1034] running on GCE node
I20260808 23:36:34.234184 9773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:34.235901 9773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:34.237139 9773 hybrid_clock.cc:648] HybridClock initialized: now 1786232194237051 us; error 74 us; skew 500 ppm
I20260808 23:36:34.237617 9773 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:34 dist-test-slave-1x4g krb5kdc[9759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232194, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:34.246542 9773 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:36:34.248627 9773 webserver.cc:460] Webserver started at http://127.26.207.254:41229/ using document root <none> and password file <none>
I20260808 23:36:34.249529 9773 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:34.249712 9773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:34.250092 9773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:36:34.253760 9773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "b991bfad02a7406d951d9c806414b4d8"
format_stamp: "Formatted at 2026-08-08 23:36:34 on dist-test-slave-1x4g"
server_key: "ba97899ca391d1840845d862ace197bd"
server_key_iv: "31f90f088271da93825e0fceb8c9252c"
server_key_version: "encryptionkey@0"
I20260808 23:36:34.254707 9773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "b991bfad02a7406d951d9c806414b4d8"
format_stamp: "Formatted at 2026-08-08 23:36:34 on dist-test-slave-1x4g"
server_key: "ba97899ca391d1840845d862ace197bd"
server_key_iv: "31f90f088271da93825e0fceb8c9252c"
server_key_version: "encryptionkey@0"
I20260808 23:36:34.261132 9773 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 23:36:34.265399 9790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:34.267081 9773 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 23:36:34.267334 9773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "b991bfad02a7406d951d9c806414b4d8"
format_stamp: "Formatted at 2026-08-08 23:36:34 on dist-test-slave-1x4g"
server_key: "ba97899ca391d1840845d862ace197bd"
server_key_iv: "31f90f088271da93825e0fceb8c9252c"
server_key_version: "encryptionkey@0"
I20260808 23:36:34.267585 9773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:34.294905 9773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:34.299558 9773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:34.299896 9773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:34.321230 9773 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:41275
I20260808 23:36:34.321269 9844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:41275 every 8 connection(s)
I20260808 23:36:34.322860 9773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:36:34.327113 9845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:36:34.332480 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 9773
I20260808 23:36:34.332758 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:36:34.333666 27455 external_mini_cluster.cc:1428] Setting key 90bda3b689bbfbae226ff24886cbbd97
I20260808 23:36:34.339954 9845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8: Bootstrap starting.
I20260808 23:36:34.343536 9845 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8: Neither blocks nor log segments found. Creating new log.
I20260808 23:36:34.345125 9845 log.cc:824] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:34.349261 9845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8: No bootstrap required, opened a new log
Aug 08 23:36:34 dist-test-slave-1x4g krb5kdc[9759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232193, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:36:34.358278 9845 raft_consensus.cc:348] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b991bfad02a7406d951d9c806414b4d8" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41275 } }
I20260808 23:36:34.358744 9845 raft_consensus.cc:374] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:36:34.358880 9845 raft_consensus.cc:729] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b991bfad02a7406d951d9c806414b4d8, State: Initialized, Role: FOLLOWER
I20260808 23:36:34.359586 9845 consensus_queue.cc:260] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b991bfad02a7406d951d9c806414b4d8" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41275 } }
I20260808 23:36:34.359862 9845 raft_consensus.cc:388] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:36:34.360049 9845 raft_consensus.cc:482] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:36:34.360261 9845 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:36:34.361990 9849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:34.336045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35720 (local address 127.26.207.254:41275)
0808 23:36:34.337142 (+ 1097us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:34.337158 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:34.337216 (+ 58us) server_negotiation.cc:407] Connection header received
0808 23:36:34.339270 (+ 2054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:34.339300 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:34.339796 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:34.340281 (+ 485us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:34.342276 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:34.343865 (+ 1589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:34.346186 (+ 2321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:34.347309 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:34.347489 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:34.353299 (+ 5810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:34.353313 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:34.353332 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:34.353396 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:34.357062 (+ 3666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:34.358023 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:34.358031 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:34.358038 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:34.358225 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:34.358678 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:34.358682 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:34.358701 (+ 19us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:34.359434 (+ 733us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:34.359784 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:34.360258 (+ 474us) server_negotiation.cc:299] Negotiation successful
0808 23:36:34.360760 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":794,"thread_start_us":495,"threads_started":1}
I20260808 23:36:34.363083 9845 raft_consensus.cc:504] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b991bfad02a7406d951d9c806414b4d8" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41275 } }
I20260808 23:36:34.363677 9845 leader_election.cc:302] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b991bfad02a7406d951d9c806414b4d8; no voters:
I20260808 23:36:34.364410 9845 leader_election.cc:288] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:36:34.364570 9851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:36:34.365938 9851 raft_consensus.cc:686] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [term 1 LEADER]: Becoming Leader. State: Replica: b991bfad02a7406d951d9c806414b4d8, State: Running, Role: LEADER
I20260808 23:36:34.366806 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:36:34.366631 9851 consensus_queue.cc:237] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b991bfad02a7406d951d9c806414b4d8" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41275 } }
I20260808 23:36:34.366926 9845 sys_catalog.cc:564] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:36:34.371886 9853 sys_catalog.cc:455] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b991bfad02a7406d951d9c806414b4d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b991bfad02a7406d951d9c806414b4d8" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41275 } } }
I20260808 23:36:34.372359 9853 sys_catalog.cc:458] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [sys.catalog]: This master's current role is: LEADER
I20260808 23:36:34.372589 9854 sys_catalog.cc:455] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b991bfad02a7406d951d9c806414b4d8. Latest consensus state: current_term: 1 leader_uuid: "b991bfad02a7406d951d9c806414b4d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b991bfad02a7406d951d9c806414b4d8" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41275 } } }
I20260808 23:36:34.373039 9854 sys_catalog.cc:458] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8 [sys.catalog]: This master's current role is: LEADER
I20260808 23:36:34.375427 9862 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:36:34.381276 9862 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:36:34.391530 9862 catalog_manager.cc:1347] Generated new cluster ID: 81ba26d46e5848d58e7ec6439ab7cfe9
I20260808 23:36:34.391688 9862 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:36:34.413477 9862 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:36:34.415174 9862 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:36:34.423672 9862 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b991bfad02a7406d951d9c806414b4d8: Generated new TSK 0
I20260808 23:36:34.424860 9862 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:36:34.484736 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 9773
I20260808 23:36:34.486200 9840 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:34.587333 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 9773
2026-08-08T23:36:34Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2308 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:36:34 dist-test-slave-1x4g krb5kdc[9878](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:36:34 dist-test-slave-1x4g krb5kdc[9878](info): set up 2 sockets
Aug 08 23:36:34 dist-test-slave-1x4g krb5kdc[9878](info): commencing operation
krb5kdc: starting...
W20260808 23:36:35.766222 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:36:35 dist-test-slave-1x4g krb5kdc[9878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:36:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:36:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:36:36.100468 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:41149
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:41149
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:36:36.474253 9892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:36.474591 9892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:36.474759 9892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:36.483161 9892 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:36:36.483295 9892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:36.483398 9892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:36.483484 9892 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:36:36.483551 9892 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:36:36.494371 9892 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:41149
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:41149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:36.495918 9892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:36.497464 9892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:36.510499 9898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:36.510579 9897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:36.510440 9900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:36.511379 9892 server_base.cc:1034] running on GCE node
I20260808 23:36:36.512316 9892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:36.514074 9892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:36.515347 9892 hybrid_clock.cc:648] HybridClock initialized: now 1786232196515286 us; error 81 us; skew 500 ppm
I20260808 23:36:36.515744 9892 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:36 dist-test-slave-1x4g krb5kdc[9878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232196, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:36.519466 9892 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:36:36.521405 9892 webserver.cc:460] Webserver started at http://127.26.207.254:35115/ using document root <none> and password file <none>
I20260808 23:36:36.522177 9892 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:36.522300 9892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:36.522585 9892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:36:36.526649 9892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "9fab5cb45fcf43efa58760d8df21fef3"
format_stamp: "Formatted at 2026-08-08 23:36:36 on dist-test-slave-1x4g"
server_key: "90ec34f501b65e63b400828a4e3866e4"
server_key_iv: "1514d349e5728cd48c686a0d369886c9"
server_key_version: "encryptionkey@0"
I20260808 23:36:36.527518 9892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "9fab5cb45fcf43efa58760d8df21fef3"
format_stamp: "Formatted at 2026-08-08 23:36:36 on dist-test-slave-1x4g"
server_key: "90ec34f501b65e63b400828a4e3866e4"
server_key_iv: "1514d349e5728cd48c686a0d369886c9"
server_key_version: "encryptionkey@0"
I20260808 23:36:36.533718 9892 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 23:36:36.537880 9907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:36.539547 9892 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:36:36.539788 9892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "9fab5cb45fcf43efa58760d8df21fef3"
format_stamp: "Formatted at 2026-08-08 23:36:36 on dist-test-slave-1x4g"
server_key: "90ec34f501b65e63b400828a4e3866e4"
server_key_iv: "1514d349e5728cd48c686a0d369886c9"
server_key_version: "encryptionkey@0"
I20260808 23:36:36.540048 9892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:36.560676 9892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:36.565835 9892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:36.566170 9892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:36.586992 9892 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:41149
I20260808 23:36:36.587037 9964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:41149 every 8 connection(s)
I20260808 23:36:36.588532 9892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:36:36.592962 9965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:36:36.594578 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 9892
I20260808 23:36:36.594815 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:36:36.595546 27455 external_mini_cluster.cc:1428] Setting key bac61edf2b9c74499e2aa8a064124cce
I20260808 23:36:36.609591 9965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3: Bootstrap starting.
Aug 08 23:36:36 dist-test-slave-1x4g krb5kdc[9878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:36:36.614459 9965 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3: Neither blocks nor log segments found. Creating new log.
I20260808 23:36:36.615924 9965 log.cc:824] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:36.620088 9965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3: No bootstrap required, opened a new log
I20260808 23:36:36.623870 9968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:36.597806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52750 (local address 127.26.207.254:41149)
0808 23:36:36.598741 (+ 935us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:36.598757 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:36.598810 (+ 53us) server_negotiation.cc:407] Connection header received
0808 23:36:36.600584 (+ 1774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:36.600613 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:36.601236 (+ 623us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:36.601653 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:36.603806 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:36.605341 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:36.607510 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:36.608458 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:36.608637 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:36.614506 (+ 5869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:36.614516 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:36.614537 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:36.614587 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:36.618551 (+ 3964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:36.619784 (+ 1233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:36.619795 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:36.619804 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:36.620048 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:36.620578 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:36.620582 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:36.620584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:36.621346 (+ 762us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:36.621616 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:36.622168 (+ 552us) server_negotiation.cc:299] Negotiation successful
0808 23:36:36.622634 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":689,"thread_start_us":448,"threads_started":1}
I20260808 23:36:36.629420 9965 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } }
I20260808 23:36:36.629887 9965 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:36:36.630012 9965 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fab5cb45fcf43efa58760d8df21fef3, State: Initialized, Role: FOLLOWER
I20260808 23:36:36.630690 9965 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } }
I20260808 23:36:36.630964 9965 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:36:36.631129 9965 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:36:36.631325 9965 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:36:36.633860 9965 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } }
I20260808 23:36:36.634465 9965 leader_election.cc:302] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fab5cb45fcf43efa58760d8df21fef3; no voters:
I20260808 23:36:36.635143 9965 leader_election.cc:288] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:36:36.635306 9970 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:36:36.636022 9970 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 1 LEADER]: Becoming Leader. State: Replica: 9fab5cb45fcf43efa58760d8df21fef3, State: Running, Role: LEADER
I20260808 23:36:36.636652 9970 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } }
I20260808 23:36:36.637526 9965 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:36:36.639640 9972 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fab5cb45fcf43efa58760d8df21fef3. Latest consensus state: current_term: 1 leader_uuid: "9fab5cb45fcf43efa58760d8df21fef3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } } }
I20260808 23:36:36.640039 9972 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [sys.catalog]: This master's current role is: LEADER
I20260808 23:36:36.641062 9979 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:36:36.641467 9971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9fab5cb45fcf43efa58760d8df21fef3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } } }
I20260808 23:36:36.641861 9971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [sys.catalog]: This master's current role is: LEADER
I20260808 23:36:36.647531 9979 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:36:36.658759 9979 catalog_manager.cc:1347] Generated new cluster ID: 9bdb331b7a324c00b2d293f3ee4c1f15
I20260808 23:36:36.658917 9979 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:36:36.679543 9979 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:36:36.681082 9979 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:36:36.687546 9979 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3: Generated new TSK 0
I20260808 23:36:36.688493 9979 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:36:36.778537 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:41149
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:36:37.174962 9994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:37.175287 9994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:37.175465 9994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:37.183288 9994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:37.183434 9994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:37.183604 9994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:36:37.194806 9994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:41149
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:37.196276 9994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:37.197842 9994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:37.212953 10003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:37.213001 10002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:37.213745 10006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:37.214006 9994 server_base.cc:1034] running on GCE node
I20260808 23:36:37.214717 9994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:37.215837 9994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:37.217137 9994 hybrid_clock.cc:648] HybridClock initialized: now 1786232197217092 us; error 40 us; skew 500 ppm
I20260808 23:36:37.217538 9994 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:37 dist-test-slave-1x4g krb5kdc[9878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232197, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:37.221395 9994 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:36:37.223187 9994 webserver.cc:460] Webserver started at http://127.26.207.193:41417/ using document root <none> and password file <none>
I20260808 23:36:37.223984 9994 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:37.224151 9994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:37.224525 9994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:36:37.227986 9994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "4d824b8f79894fccb5162202ca9145f6"
format_stamp: "Formatted at 2026-08-08 23:36:37 on dist-test-slave-1x4g"
server_key: "f9428120ca7fca781664bd54a4b7da1e"
server_key_iv: "34b76a84d4e66985485f6a8af3fdf1e7"
server_key_version: "encryptionkey@0"
I20260808 23:36:37.229058 9994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "4d824b8f79894fccb5162202ca9145f6"
format_stamp: "Formatted at 2026-08-08 23:36:37 on dist-test-slave-1x4g"
server_key: "f9428120ca7fca781664bd54a4b7da1e"
server_key_iv: "34b76a84d4e66985485f6a8af3fdf1e7"
server_key_version: "encryptionkey@0"
I20260808 23:36:37.235343 9994 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.001s
I20260808 23:36:37.239500 10014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:37.241174 9994 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:36:37.241398 9994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "4d824b8f79894fccb5162202ca9145f6"
format_stamp: "Formatted at 2026-08-08 23:36:37 on dist-test-slave-1x4g"
server_key: "f9428120ca7fca781664bd54a4b7da1e"
server_key_iv: "34b76a84d4e66985485f6a8af3fdf1e7"
server_key_version: "encryptionkey@0"
I20260808 23:36:37.241667 9994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:37.255208 9994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:37.259836 9994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:37.260183 9994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:37.261401 9994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:36:37.263007 9994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:36:37.263127 9994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:37.263283 9994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:36:37.263358 9994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:37.299755 9994 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:37483
I20260808 23:36:37.299817 10141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:37483 every 8 connection(s)
I20260808 23:36:37.301254 9994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:36:37.303833 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 9994
I20260808 23:36:37.304080 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:36:37.304935 27455 external_mini_cluster.cc:1428] Setting key d368ab0ae055e0523c4e977e8e9df034
Aug 08 23:36:37 dist-test-slave-1x4g krb5kdc[9878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232197, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:36:37.325438 10144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:37.304118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:55163 (local address 127.26.207.254:41149)
0808 23:36:37.304632 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:37.304639 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:37.306166 (+ 1527us) server_negotiation.cc:407] Connection header received
0808 23:36:37.308246 (+ 2080us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:37.308252 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:37.308354 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:37.308504 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:37.310286 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:37.311026 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:37.312711 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:37.313262 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:37.313417 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:37.317682 (+ 4265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:37.317688 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:37.317691 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:37.317735 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:37.321260 (+ 3525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:37.322489 (+ 1229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:37.322495 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:37.322498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:37.322652 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:37.323318 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:37.323322 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:37.323324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:37.323636 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:37.323759 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:37.324935 (+ 1176us) server_negotiation.cc:299] Negotiation successful
0808 23:36:37.325145 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":248,"threads_started":1}
I20260808 23:36:37.327009 10145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:37.304848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:55163)
0808 23:36:37.305844 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:37.305908 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:37.307922 (+ 2014us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:37.308829 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:37.308846 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:37.309448 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:37.310082 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:37.310102 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:37.311221 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:37.311225 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:37.312527 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:37.312540 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:37.313546 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:37.313554 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:37.313802 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:37.314566 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:37.314591 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:37.317364 (+ 2773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:37.321500 (+ 4136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:37.321515 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:37.321548 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:37.322309 (+ 761us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:37.322790 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:37.322798 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:37.322804 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:37.323180 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:37.323788 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:37.323800 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:37.324343 (+ 543us) client_negotiation.cc:769] Sending connection context
0808 23:36:37.324739 (+ 396us) client_negotiation.cc:240] Negotiation successful
0808 23:36:37.325427 (+ 688us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"thread_start_us":385,"threads_started":1}
I20260808 23:36:37.328900 10142 heartbeater.cc:347] Connected to a master server at 127.26.207.254:41149
I20260808 23:36:37.329263 10142 heartbeater.cc:464] Registering TS with master...
I20260808 23:36:37.330109 10142 heartbeater.cc:511] Master 127.26.207.254:41149 requested a full tablet report, sending...
I20260808 23:36:37.332544 9925 ts_manager.cc:194] Registered new tserver with Master: 4d824b8f79894fccb5162202ca9145f6 (127.26.207.193:37483)
I20260808 23:36:37.334169 9925 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:55163
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:36:37.380744 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:41149
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:36:37.749506 10149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:37.749938 10149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:37.750066 10149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:37.758116 10149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:37.758258 10149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:37.758378 10149 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:36:37.769263 10149 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:41149
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:37.770680 10149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:37.772497 10149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:37.788569 10155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:37.788655 10154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:37.788687 10158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:37.789245 10149 server_base.cc:1034] running on GCE node
I20260808 23:36:37.789975 10149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:37.791139 10149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:37.792404 10149 hybrid_clock.cc:648] HybridClock initialized: now 1786232197792346 us; error 61 us; skew 500 ppm
I20260808 23:36:37.792835 10149 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:37 dist-test-slave-1x4g krb5kdc[9878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232197, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:37.796264 10149 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:36:37.797955 10149 webserver.cc:460] Webserver started at http://127.26.207.194:39687/ using document root <none> and password file <none>
I20260808 23:36:37.798728 10149 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:37.798851 10149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:37.799153 10149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:36:37.802596 10149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "40fa47506b64458bac27e8feb323ec87"
format_stamp: "Formatted at 2026-08-08 23:36:37 on dist-test-slave-1x4g"
server_key: "5c1bc90ff36115d70d81db83c793cae8"
server_key_iv: "506cc3c47ac373e16ad0b446fb2a9d3a"
server_key_version: "encryptionkey@0"
I20260808 23:36:37.803557 10149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "40fa47506b64458bac27e8feb323ec87"
format_stamp: "Formatted at 2026-08-08 23:36:37 on dist-test-slave-1x4g"
server_key: "5c1bc90ff36115d70d81db83c793cae8"
server_key_iv: "506cc3c47ac373e16ad0b446fb2a9d3a"
server_key_version: "encryptionkey@0"
I20260808 23:36:37.809782 10149 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260808 23:36:37.814198 10165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:37.815986 10149 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 23:36:37.816234 10149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "40fa47506b64458bac27e8feb323ec87"
format_stamp: "Formatted at 2026-08-08 23:36:37 on dist-test-slave-1x4g"
server_key: "5c1bc90ff36115d70d81db83c793cae8"
server_key_iv: "506cc3c47ac373e16ad0b446fb2a9d3a"
server_key_version: "encryptionkey@0"
I20260808 23:36:37.816470 10149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:37.835119 10149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:37.839902 10149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:37.840386 10149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:37.841648 10149 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:36:37.843290 10149 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:36:37.843390 10149 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:37.843542 10149 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:36:37.843597 10149 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:37.883045 10149 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:34147
I20260808 23:36:37.883090 10287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:34147 every 8 connection(s)
I20260808 23:36:37.884510 10149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:36:37.894038 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 10149
I20260808 23:36:37.894268 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:36:37.894734 27455 external_mini_cluster.cc:1428] Setting key 7631e325d94b3ffd27abf1a9edb9e0c2
Aug 08 23:36:37 dist-test-slave-1x4g krb5kdc[9878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232197, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:36:37.909096 10290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:37.887376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:52951 (local address 127.26.207.254:41149)
0808 23:36:37.887880 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:37.887886 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:37.888850 (+ 964us) server_negotiation.cc:407] Connection header received
0808 23:36:37.890852 (+ 2002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:37.890857 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:37.890962 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:37.891091 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:37.892832 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:37.893673 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:37.895859 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:37.896469 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:37.896594 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:37.901120 (+ 4526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:37.901130 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:37.901139 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:37.901198 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:37.905143 (+ 3945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:37.906095 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:37.906104 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:37.906110 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:37.906297 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:37.906752 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:37.906759 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:37.906765 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:37.907177 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:37.907348 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:37.908234 (+ 886us) server_negotiation.cc:299] Negotiation successful
0808 23:36:37.908529 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":284,"threads_started":1}
I20260808 23:36:37.909816 10291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:37.887873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:52951)
0808 23:36:37.888648 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:37.888690 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:37.890528 (+ 1838us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:37.891376 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:37.891386 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:37.891964 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:37.892590 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:37.892610 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:37.893921 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:37.893927 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:37.895683 (+ 1756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:37.895701 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:37.896828 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:37.896838 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:37.897269 (+ 431us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:37.898183 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:37.898216 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:37.900682 (+ 2466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:37.905362 (+ 4680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:37.905371 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:37.905389 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:37.905931 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:37.906425 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:37.906428 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:37.906430 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:37.906636 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:37.907347 (+ 711us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:37.907359 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:37.907820 (+ 461us) client_negotiation.cc:769] Sending connection context
0808 23:36:37.908089 (+ 269us) client_negotiation.cc:240] Negotiation successful
0808 23:36:37.908545 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":299,"threads_started":1}
I20260808 23:36:37.911681 10288 heartbeater.cc:347] Connected to a master server at 127.26.207.254:41149
I20260808 23:36:37.912083 10288 heartbeater.cc:464] Registering TS with master...
I20260808 23:36:37.913029 10288 heartbeater.cc:511] Master 127.26.207.254:41149 requested a full tablet report, sending...
I20260808 23:36:37.914948 9925 ts_manager.cc:194] Registered new tserver with Master: 40fa47506b64458bac27e8feb323ec87 (127.26.207.194:34147)
I20260808 23:36:37.915879 9925 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:52951
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:36:37.970067 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:41149
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:36:38.338061 10142 heartbeater.cc:503] Master 127.26.207.254:41149 was elected leader, sending a full tablet report...
W20260808 23:36:38.345243 10294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:38.345615 10294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:38.345781 10294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:38.353742 10294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:38.353929 10294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:38.354135 10294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:36:38.364426 10294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:41149
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:38.366032 10294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:38.367535 10294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:38.383337 10300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:38.383437 10299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:38.383603 10302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:38.384392 10294 server_base.cc:1034] running on GCE node
I20260808 23:36:38.385205 10294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:38.386336 10294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:38.387594 10294 hybrid_clock.cc:648] HybridClock initialized: now 1786232198387508 us; error 65 us; skew 500 ppm
I20260808 23:36:38.388008 10294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:38 dist-test-slave-1x4g krb5kdc[9878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232198, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:38.391829 10294 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:36:38.393923 10294 webserver.cc:460] Webserver started at http://127.26.207.195:46179/ using document root <none> and password file <none>
I20260808 23:36:38.394809 10294 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:38.394994 10294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:38.395390 10294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:36:38.399144 10294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "ff04239a74cc47b3b34523e8d5db3cf1"
format_stamp: "Formatted at 2026-08-08 23:36:38 on dist-test-slave-1x4g"
server_key: "2fd0a6cf7aa7e413c3e405509f3208c7"
server_key_iv: "8980c90ca242ae4564441cb9c26d4310"
server_key_version: "encryptionkey@0"
I20260808 23:36:38.400097 10294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "ff04239a74cc47b3b34523e8d5db3cf1"
format_stamp: "Formatted at 2026-08-08 23:36:38 on dist-test-slave-1x4g"
server_key: "2fd0a6cf7aa7e413c3e405509f3208c7"
server_key_iv: "8980c90ca242ae4564441cb9c26d4310"
server_key_version: "encryptionkey@0"
I20260808 23:36:38.406335 10294 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 23:36:38.410987 10310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:38.412645 10294 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 23:36:38.412950 10294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "ff04239a74cc47b3b34523e8d5db3cf1"
format_stamp: "Formatted at 2026-08-08 23:36:38 on dist-test-slave-1x4g"
server_key: "2fd0a6cf7aa7e413c3e405509f3208c7"
server_key_iv: "8980c90ca242ae4564441cb9c26d4310"
server_key_version: "encryptionkey@0"
I20260808 23:36:38.413218 10294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:38.433475 10294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:38.439428 10294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:38.439836 10294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:38.441149 10294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:36:38.442974 10294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:36:38.443111 10294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:38.443323 10294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:36:38.443413 10294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:38.482532 10294 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:38889
I20260808 23:36:38.482633 10434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:38889 every 8 connection(s)
I20260808 23:36:38.484015 10294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:36:38.484912 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 10294
I20260808 23:36:38.485172 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:36:38.485841 27455 external_mini_cluster.cc:1428] Setting key 05fa8ce5508dce39e9ce2f7ab51822ed
Aug 08 23:36:38 dist-test-slave-1x4g krb5kdc[9878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232198, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:36:38.507335 10437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:38.487101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:45345 (local address 127.26.207.254:41149)
0808 23:36:38.490323 (+ 3222us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:38.490328 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:38.490348 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:36:38.491497 (+ 1149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:38.491502 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:38.491581 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:38.491692 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:38.493464 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.494301 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.495977 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.496410 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.496516 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:38.500516 (+ 4000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:38.500529 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:38.500532 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:38.500573 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:38.503792 (+ 3219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:38.504662 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:38.504675 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:38.504678 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:38.504876 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:38.505370 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:38.505376 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:38.505379 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:38.505692 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:38.505867 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:38.506665 (+ 798us) server_negotiation.cc:299] Negotiation successful
0808 23:36:38.506924 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3115,"thread_start_us":2960,"threads_started":1}
I20260808 23:36:38.508368 10440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:38.488101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:45345)
0808 23:36:38.489259 (+ 1158us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:38.489320 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:38.491151 (+ 1831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:38.491930 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:38.491942 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:38.492526 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:38.493242 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:38.493264 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.494476 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.494479 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:38.495811 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:38.495826 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.496656 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.496661 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:38.496983 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:38.497689 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:38.497719 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:38.500226 (+ 2507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:38.503981 (+ 3755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:38.503990 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:38.504007 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:38.504509 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:38.505007 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:38.505013 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:38.505015 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:38.505235 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:38.505835 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:38.505845 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:38.506254 (+ 409us) client_negotiation.cc:769] Sending connection context
0808 23:36:38.506552 (+ 298us) client_negotiation.cc:240] Negotiation successful
0808 23:36:38.507160 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":792,"thread_start_us":482,"threads_started":1}
I20260808 23:36:38.510207 10435 heartbeater.cc:347] Connected to a master server at 127.26.207.254:41149
I20260808 23:36:38.510576 10435 heartbeater.cc:464] Registering TS with master...
I20260808 23:36:38.511435 10435 heartbeater.cc:511] Master 127.26.207.254:41149 requested a full tablet report, sending...
I20260808 23:36:38.513382 9925 ts_manager.cc:194] Registered new tserver with Master: ff04239a74cc47b3b34523e8d5db3cf1 (127.26.207.195:38889)
I20260808 23:36:38.514549 9925 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:45345
I20260808 23:36:38.515520 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:36:38.536064 10437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:38.520694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52764 (local address 127.26.207.254:41149)
0808 23:36:38.520932 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:38.520940 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:38.521357 (+ 417us) server_negotiation.cc:407] Connection header received
0808 23:36:38.521615 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:38.521620 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:38.521693 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:38.521809 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:38.523360 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.524287 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.525916 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.526349 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.526498 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:38.529197 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:38.529202 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:38.529206 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:38.529247 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:38.532852 (+ 3605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:38.533730 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:38.533737 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:38.533741 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:38.533907 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:38.534386 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:38.534392 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:38.534395 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:38.534793 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:38.535084 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:38.535458 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 23:36:38.535720 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 23:36:38.540925 9925 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52764:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:36:38.548638 9925 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:36:38.573457 10452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:38.562787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:37483 (local address 127.0.0.1:41896)
0808 23:36:38.564156 (+ 1369us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:38.564201 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:38.564439 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:38.565597 (+ 1158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:38.565605 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:38.565644 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:36:38.566513 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:38.566526 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.568282 (+ 1756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.568288 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:38.570760 (+ 2472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:38.570774 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.572239 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.572245 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:38.572491 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:38.572556 (+ 65us) client_negotiation.cc:769] Sending connection context
0808 23:36:38.572690 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 23:36:38.572942 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1112,"mutex_wait_us":53,"thread_start_us":1671,"threads_started":1}
I20260808 23:36:38.574621 10453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:38.563289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41896 (local address 127.26.207.193:37483)
0808 23:36:38.564188 (+ 899us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:38.564197 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:38.564321 (+ 124us) server_negotiation.cc:407] Connection header received
0808 23:36:38.564746 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:38.564755 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:38.565067 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:38.565286 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:36:38.566710 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.568143 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.570941 (+ 2798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.572015 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.572591 (+ 576us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:38.573875 (+ 1284us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:38.573966 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 23:36:38.574153 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":722,"thread_start_us":520,"threads_started":1}
I20260808 23:36:38.574661 10450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:38.562798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35622 (local address 127.26.207.195:38889)
0808 23:36:38.563563 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:38.563578 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:38.565129 (+ 1551us) server_negotiation.cc:407] Connection header received
0808 23:36:38.565245 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:38.565256 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:38.565499 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:38.565708 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:36:38.566936 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.568609 (+ 1673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.571580 (+ 2971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.573148 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.573326 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:38.573531 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:38.574207 (+ 676us) server_negotiation.cc:299] Negotiation successful
0808 23:36:38.574381 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":342,"threads_started":1}
I20260808 23:36:38.575287 10454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:38.565131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:34147 (local address 127.0.0.1:59706)
0808 23:36:38.565727 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:38.565746 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:38.565868 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:38.567131 (+ 1263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:38.567136 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:38.567165 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:36:38.567544 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:38.567556 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.569494 (+ 1938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.569500 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:38.571863 (+ 2363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:38.571877 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.574290 (+ 2413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.574296 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:38.574594 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:38.574638 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 23:36:38.574761 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 23:36:38.574939 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"mutex_wait_us":63,"thread_start_us":761,"threads_started":1}
I20260808 23:36:38.575603 10451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:38.562809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:38889 (local address 127.0.0.1:35622)
0808 23:36:38.564830 (+ 2021us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:38.564849 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:38.564970 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:38.566024 (+ 1054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:38.566028 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:38.566047 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:36:38.566690 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:38.566705 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.568825 (+ 2120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.568830 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:38.571357 (+ 2527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:38.571375 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.573744 (+ 2369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.573752 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:38.573965 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:38.574005 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 23:36:38.574975 (+ 970us) client_negotiation.cc:240] Negotiation successful
0808 23:36:38.575135 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1838,"mutex_wait_us":44,"thread_start_us":856,"threads_started":1}
I20260808 23:36:38.576462 10455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:38.565701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59706 (local address 127.26.207.194:34147)
0808 23:36:38.566517 (+ 816us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:38.566528 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:38.566558 (+ 30us) server_negotiation.cc:407] Connection header received
0808 23:36:38.566664 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:38.566672 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:38.566902 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:38.567133 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:36:38.567739 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.569304 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.572053 (+ 2749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.573521 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.573997 (+ 476us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:38.574153 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:38.575658 (+ 1505us) server_negotiation.cc:299] Negotiation successful
0808 23:36:38.576121 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":640,"thread_start_us":528,"threads_started":1}
I20260808 23:36:38.579506 10069 tablet_service.cc:1467] Processing CreateTablet for tablet ef5966dbbbd14a0d959cc69432ee8619 (DEFAULT_TABLE table=test-table [id=cd17d0bcbd6e4502ac6a4c6829f60da4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:36:38.580094 10363 tablet_service.cc:1467] Processing CreateTablet for tablet ef5966dbbbd14a0d959cc69432ee8619 (DEFAULT_TABLE table=test-table [id=cd17d0bcbd6e4502ac6a4c6829f60da4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:36:38.580391 10219 tablet_service.cc:1467] Processing CreateTablet for tablet ef5966dbbbd14a0d959cc69432ee8619 (DEFAULT_TABLE table=test-table [id=cd17d0bcbd6e4502ac6a4c6829f60da4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:36:38.580988 10069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef5966dbbbd14a0d959cc69432ee8619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:36:38.581871 10219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef5966dbbbd14a0d959cc69432ee8619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:36:38.581887 10363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef5966dbbbd14a0d959cc69432ee8619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:36:38.602864 10456 tablet_bootstrap.cc:492] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6: Bootstrap starting.
I20260808 23:36:38.605466 10458 tablet_bootstrap.cc:492] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1: Bootstrap starting.
I20260808 23:36:38.605466 10457 tablet_bootstrap.cc:492] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87: Bootstrap starting.
I20260808 23:36:38.609861 10456 tablet_bootstrap.cc:654] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6: Neither blocks nor log segments found. Creating new log.
I20260808 23:36:38.609871 10457 tablet_bootstrap.cc:654] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87: Neither blocks nor log segments found. Creating new log.
I20260808 23:36:38.611393 10456 log.cc:824] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:38.611439 10457 log.cc:824] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:38.611593 10458 tablet_bootstrap.cc:654] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1: Neither blocks nor log segments found. Creating new log.
I20260808 23:36:38.613274 10458 log.cc:824] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:38.620960 10456 tablet_bootstrap.cc:492] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6: No bootstrap required, opened a new log
I20260808 23:36:38.620961 10458 tablet_bootstrap.cc:492] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1: No bootstrap required, opened a new log
I20260808 23:36:38.621304 10456 ts_tablet_manager.cc:1397] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.006s
I20260808 23:36:38.621304 10458 ts_tablet_manager.cc:1397] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.002s
I20260808 23:36:38.621476 10457 tablet_bootstrap.cc:492] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87: No bootstrap required, opened a new log
I20260808 23:36:38.621790 10457 ts_tablet_manager.cc:1397] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.008s
I20260808 23:36:38.630636 10457 raft_consensus.cc:348] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } }
I20260808 23:36:38.631174 10457 raft_consensus.cc:374] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:36:38.631359 10457 raft_consensus.cc:729] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fa47506b64458bac27e8feb323ec87, State: Initialized, Role: FOLLOWER
I20260808 23:36:38.632128 10457 consensus_queue.cc:260] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } }
I20260808 23:36:38.633062 10456 raft_consensus.cc:348] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } }
I20260808 23:36:38.633073 10458 raft_consensus.cc:348] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } }
I20260808 23:36:38.633550 10458 raft_consensus.cc:374] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:36:38.633581 10288 heartbeater.cc:503] Master 127.26.207.254:41149 was elected leader, sending a full tablet report...
I20260808 23:36:38.633596 10456 raft_consensus.cc:374] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:36:38.633702 10456 raft_consensus.cc:729] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d824b8f79894fccb5162202ca9145f6, State: Initialized, Role: FOLLOWER
I20260808 23:36:38.633695 10458 raft_consensus.cc:729] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff04239a74cc47b3b34523e8d5db3cf1, State: Initialized, Role: FOLLOWER
I20260808 23:36:38.634488 10457 ts_tablet_manager.cc:1428] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87: Time spent starting tablet: real 0.013s user 0.008s sys 0.003s
I20260808 23:36:38.634419 10458 consensus_queue.cc:260] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } }
I20260808 23:36:38.634418 10456 consensus_queue.cc:260] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } }
I20260808 23:36:38.636175 10435 heartbeater.cc:503] Master 127.26.207.254:41149 was elected leader, sending a full tablet report...
I20260808 23:36:38.636471 10458 ts_tablet_manager.cc:1428] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1: Time spent starting tablet: real 0.015s user 0.013s sys 0.001s
W20260808 23:36:38.636794 10289 tablet.cc:2369] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:36:38.638044 10456 ts_tablet_manager.cc:1428] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6: Time spent starting tablet: real 0.017s user 0.011s sys 0.004s
I20260808 23:36:38.642803 10467 raft_consensus.cc:482] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:36:38.643154 10467 raft_consensus.cc:504] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } }
I20260808 23:36:38.645066 10467 leader_election.cc:288] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d824b8f79894fccb5162202ca9145f6 (127.26.207.193:37483), 40fa47506b64458bac27e8feb323ec87 (127.26.207.194:34147)
I20260808 23:36:38.652066 10453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:38.645609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:44631 (local address 127.26.207.193:37483)
0808 23:36:38.645832 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:38.645838 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:38.645863 (+ 25us) server_negotiation.cc:407] Connection header received
0808 23:36:38.646048 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:38.646053 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:38.646136 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:38.646235 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:36:38.646789 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.647899 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.649948 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.651216 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.651376 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:38.651433 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:38.651765 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 23:36:38.651865 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 23:36:38.652170 10440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:38.645529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:37483 (local address 127.26.207.195:44631)
0808 23:36:38.645756 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:38.645783 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:38.645891 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:38.646292 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:38.646299 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:38.646337 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:36:38.646598 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:38.646613 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.648068 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.648074 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:38.649771 (+ 1697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:38.649787 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.651376 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.651381 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:38.651592 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:38.651631 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 23:36:38.651736 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 23:36:38.651885 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 23:36:38.653548 10468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:38.646029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:34147 (local address 127.26.207.195:53119)
0808 23:36:38.646786 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:38.646804 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:38.646989 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:38.647329 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:38.647334 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:38.647359 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:36:38.647682 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:38.647693 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.649215 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.649219 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:38.651125 (+ 1906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:38.651143 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.652853 (+ 1710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.652862 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:38.653039 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:38.653079 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 23:36:38.653173 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 23:36:38.653274 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":488,"threads_started":1}
I20260808 23:36:38.653664 10455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:38.646206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:53119 (local address 127.26.207.194:34147)
0808 23:36:38.646505 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:38.646513 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:38.646886 (+ 373us) server_negotiation.cc:407] Connection header received
0808 23:36:38.647149 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:38.647153 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:38.647213 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:38.647286 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:36:38.647826 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.648962 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.651346 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.652601 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.652751 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:38.652873 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:38.653248 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 23:36:38.653393 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
I20260808 23:36:38.653683 10091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef5966dbbbd14a0d959cc69432ee8619" candidate_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d824b8f79894fccb5162202ca9145f6" is_pre_election: true
I20260808 23:36:38.654354 10091 raft_consensus.cc:2454] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff04239a74cc47b3b34523e8d5db3cf1 in term 0.
I20260808 23:36:38.654798 10239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef5966dbbbd14a0d959cc69432ee8619" candidate_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fa47506b64458bac27e8feb323ec87" is_pre_election: true
I20260808 23:36:38.655201 10311 leader_election.cc:302] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d824b8f79894fccb5162202ca9145f6, ff04239a74cc47b3b34523e8d5db3cf1; no voters:
I20260808 23:36:38.655400 10239 raft_consensus.cc:2454] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff04239a74cc47b3b34523e8d5db3cf1 in term 0.
I20260808 23:36:38.655649 10467 raft_consensus.cc:2781] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:36:38.655823 10467 raft_consensus.cc:482] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:36:38.655946 10467 raft_consensus.cc:3037] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:36:38.658560 10467 raft_consensus.cc:504] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } }
I20260808 23:36:38.659222 10467 leader_election.cc:288] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [CANDIDATE]: Term 1 election: Requested vote from peers 4d824b8f79894fccb5162202ca9145f6 (127.26.207.193:37483), 40fa47506b64458bac27e8feb323ec87 (127.26.207.194:34147)
I20260808 23:36:38.659868 10239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef5966dbbbd14a0d959cc69432ee8619" candidate_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fa47506b64458bac27e8feb323ec87"
I20260808 23:36:38.659857 10091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef5966dbbbd14a0d959cc69432ee8619" candidate_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d824b8f79894fccb5162202ca9145f6"
I20260808 23:36:38.660113 10091 raft_consensus.cc:3037] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:36:38.660094 10239 raft_consensus.cc:3037] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:36:38.662601 10239 raft_consensus.cc:2454] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff04239a74cc47b3b34523e8d5db3cf1 in term 1.
I20260808 23:36:38.662604 10091 raft_consensus.cc:2454] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff04239a74cc47b3b34523e8d5db3cf1 in term 1.
I20260808 23:36:38.663165 10311 leader_election.cc:302] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d824b8f79894fccb5162202ca9145f6, ff04239a74cc47b3b34523e8d5db3cf1; no voters:
I20260808 23:36:38.663534 10467 raft_consensus.cc:2781] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:36:38.664022 10467 raft_consensus.cc:686] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [term 1 LEADER]: Becoming Leader. State: Replica: ff04239a74cc47b3b34523e8d5db3cf1, State: Running, Role: LEADER
I20260808 23:36:38.664566 10467 consensus_queue.cc:237] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } }
I20260808 23:36:38.670157 9923 catalog_manager.cc:5495] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff04239a74cc47b3b34523e8d5db3cf1 (127.26.207.195). New cstate: current_term: 1 leader_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } health_report { overall_health: UNKNOWN } } }
I20260808 23:36:38.691291 10450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:38.685218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35630 (local address 127.26.207.195:38889)
0808 23:36:38.685481 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:38.685488 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:38.685570 (+ 82us) server_negotiation.cc:407] Connection header received
0808 23:36:38.685853 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:38.685858 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:38.685961 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:38.686136 (+ 175us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:36:38.686582 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.687340 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.688906 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.689328 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.689487 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:38.690077 (+ 590us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:36:38.690660 (+ 583us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:36:38.690841 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:38.690903 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 23:36:38.690995 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 23:36:38.700477 10239 raft_consensus.cc:1261] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87 [term 1 FOLLOWER]: Refusing update from remote peer ff04239a74cc47b3b34523e8d5db3cf1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:36:38.700476 10091 raft_consensus.cc:1261] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6 [term 1 FOLLOWER]: Refusing update from remote peer ff04239a74cc47b3b34523e8d5db3cf1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:36:38.701728 10469 consensus_queue.cc:1035] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:36:38.702225 10467 consensus_queue.cc:1035] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:36:38.714335 10472 mvcc.cc:205] Tried to move back new op lower bound from 7316407085865811968 to 7316407085734674432. Current Snapshot: MvccSnapshot[applied={T|T < 7316407085865811968}]
I20260808 23:36:38.739215 9923 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:36:38.739548 9923 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:36:38.743800 9923 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3: Sending DeleteTablet for 3 replicas of tablet ef5966dbbbd14a0d959cc69432ee8619
I20260808 23:36:38.745360 10363 tablet_service.cc:1514] Processing DeleteTablet for tablet ef5966dbbbd14a0d959cc69432ee8619 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:36:38 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:35622
I20260808 23:36:38.745580 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 9994
I20260808 23:36:38.745887 10069 tablet_service.cc:1514] Processing DeleteTablet for tablet ef5966dbbbd14a0d959cc69432ee8619 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:36:38 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:41896
I20260808 23:36:38.746099 10219 tablet_service.cc:1514] Processing DeleteTablet for tablet ef5966dbbbd14a0d959cc69432ee8619 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:36:38 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:59706
I20260808 23:36:38.755146 10485 tablet_replica.cc:330] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87: stopping tablet replica
I20260808 23:36:38.757009 10485 raft_consensus.cc:2229] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:36:38.758663 10484 tablet_replica.cc:330] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6: stopping tablet replica
I20260808 23:36:38.758860 10485 raft_consensus.cc:2258] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:36:38.759402 10484 raft_consensus.cc:2229] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:36:38.760058 10484 raft_consensus.cc:2258] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:36:38.761082 10483 tablet_replica.cc:330] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1: stopping tablet replica
I20260808 23:36:38.761641 10483 raft_consensus.cc:2229] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:36:38.762445 10483 raft_consensus.cc:2258] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:36:38.763787 10485 ts_tablet_manager.cc:1905] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:36:38.764341 10484 ts_tablet_manager.cc:1905] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:36:38.766115 10483 ts_tablet_manager.cc:1905] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:36:38.772193 10484 ts_tablet_manager.cc:1918] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:36:38.772383 10485 ts_tablet_manager.cc:1918] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:36:38.772526 10484 log.cc:1196] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/ef5966dbbbd14a0d959cc69432ee8619
I20260808 23:36:38.772691 10485 log.cc:1196] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/ef5966dbbbd14a0d959cc69432ee8619
I20260808 23:36:38.773295 10484 ts_tablet_manager.cc:1939] T ef5966dbbbd14a0d959cc69432ee8619 P 4d824b8f79894fccb5162202ca9145f6: Deleting consensus metadata
I20260808 23:36:38.773494 10485 ts_tablet_manager.cc:1939] T ef5966dbbbd14a0d959cc69432ee8619 P 40fa47506b64458bac27e8feb323ec87: Deleting consensus metadata
I20260808 23:36:38.775691 9908 catalog_manager.cc:4841] TS 40fa47506b64458bac27e8feb323ec87 (127.26.207.194:34147): tablet ef5966dbbbd14a0d959cc69432ee8619 (table test-table [id=cd17d0bcbd6e4502ac6a4c6829f60da4]) successfully deleted
I20260808 23:36:38.776096 9908 catalog_manager.cc:4841] TS 4d824b8f79894fccb5162202ca9145f6 (127.26.207.193:37483): tablet ef5966dbbbd14a0d959cc69432ee8619 (table test-table [id=cd17d0bcbd6e4502ac6a4c6829f60da4]) successfully deleted
I20260808 23:36:38.779189 10483 ts_tablet_manager.cc:1918] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:36:38.779510 10483 log.cc:1196] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/ef5966dbbbd14a0d959cc69432ee8619
I20260808 23:36:38.780303 10483 ts_tablet_manager.cc:1939] T ef5966dbbbd14a0d959cc69432ee8619 P ff04239a74cc47b3b34523e8d5db3cf1: Deleting consensus metadata
I20260808 23:36:38.782882 9910 catalog_manager.cc:4841] TS ff04239a74cc47b3b34523e8d5db3cf1 (127.26.207.195:38889): tablet ef5966dbbbd14a0d959cc69432ee8619 (table test-table [id=cd17d0bcbd6e4502ac6a4c6829f60da4]) successfully deleted
Aug 08 23:36:38 dist-test-slave-1x4g krb5kdc[9878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:36:38.792094 10453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:38.748256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41910 (local address 127.26.207.193:37483)
0808 23:36:38.748544 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:38.748554 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:38.760904 (+ 12350us) server_negotiation.cc:407] Connection header received
0808 23:36:38.761526 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:38.761533 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:38.761654 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:38.761752 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:38.766402 (+ 4650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.767778 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.777089 (+ 9311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.777836 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.777968 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:38.784869 (+ 6901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:38.784900 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:38.784918 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:38.784967 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:38.788391 (+ 3424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:38.789488 (+ 1097us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:38.789507 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:38.789510 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:38.789688 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:38.790193 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:38.790199 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:38.790203 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:38.790639 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:38.791071 (+ 432us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:38.791379 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 23:36:38.791663 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 23:36:38.792944 10137 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:38.893087 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 9994
I20260808 23:36:38.916239 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 10149
Aug 08 23:36:38 dist-test-slave-1x4g krb5kdc[9878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:36:38.940361 10455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:38.917261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59708 (local address 127.26.207.194:34147)
0808 23:36:38.917486 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:38.917492 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:38.917514 (+ 22us) server_negotiation.cc:407] Connection header received
0808 23:36:38.917683 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:38.917689 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:38.917781 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:38.917899 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:38.919409 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.920216 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.921802 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:38.922224 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:38.922374 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:38.932670 (+ 10296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:38.932689 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:38.932705 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:38.932754 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:38.936752 (+ 3998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:38.937791 (+ 1039us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:38.937802 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:38.937807 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:38.937972 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:38.938437 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:38.938442 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:38.938445 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:38.938949 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:38.939281 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:38.939618 (+ 337us) server_negotiation.cc:299] Negotiation successful
0808 23:36:38.939863 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 23:36:38.941200 10283 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:39.036988 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 10149
I20260808 23:36:39.060060 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 10294
Aug 08 23:36:39 dist-test-slave-1x4g krb5kdc[9878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:36:39.080381 10450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:39.061213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35642 (local address 127.26.207.195:38889)
0808 23:36:39.061446 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:39.061455 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:39.061479 (+ 24us) server_negotiation.cc:407] Connection header received
0808 23:36:39.061559 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:39.061564 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:39.061628 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:39.061741 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:39.063055 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:39.063965 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:39.065491 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:39.065984 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:39.066144 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:39.071535 (+ 5391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:39.071559 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:39.071581 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:39.071657 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:39.076562 (+ 4905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:39.077680 (+ 1118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:39.077694 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:39.077698 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:39.077941 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:39.078405 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:39.078410 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:39.078413 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:39.078928 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:39.079306 (+ 378us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:39.079656 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 23:36:39.079923 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 23:36:39.081349 10430 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:39.233990 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 10294
I20260808 23:36:39.260452 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 9892
I20260808 23:36:39.261817 9958 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:39.376523 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 9892
I20260808 23:36:39.405557 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:41149
--webserver_interface=127.26.207.254
--webserver_port=35115
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:41149
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:36:39.784130 10491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:39.784487 10491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:39.784642 10491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:39.792403 10491 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:36:39.792543 10491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:39.792629 10491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:39.792719 10491 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:36:39.792829 10491 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:36:39.803527 10491 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:41149
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:41149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=35115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:39.805121 10491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:39.806655 10491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:39.835788 10497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:39.835774 10500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:39.835698 10498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:39.838483 10491 server_base.cc:1034] running on GCE node
I20260808 23:36:39.839561 10491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:39.841591 10491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:39.842895 10491 hybrid_clock.cc:648] HybridClock initialized: now 1786232199842836 us; error 52 us; skew 500 ppm
I20260808 23:36:39.843411 10491 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:39 dist-test-slave-1x4g krb5kdc[9878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232199, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:39.852286 10491 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:36:39.854449 10491 webserver.cc:460] Webserver started at http://127.26.207.254:35115/ using document root <none> and password file <none>
I20260808 23:36:39.855309 10491 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:39.855443 10491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:39.862396 10491 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 23:36:39.866206 10507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:39.867970 10491 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 23:36:39.868221 10491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "9fab5cb45fcf43efa58760d8df21fef3"
format_stamp: "Formatted at 2026-08-08 23:36:36 on dist-test-slave-1x4g"
server_key: "90ec34f501b65e63b400828a4e3866e4"
server_key_iv: "1514d349e5728cd48c686a0d369886c9"
server_key_version: "encryptionkey@0"
I20260808 23:36:39.869608 10491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:39.891759 10491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:39.896306 10491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:39.896651 10491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:39.918042 10491 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:41149
I20260808 23:36:39.918111 10564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:41149 every 8 connection(s)
I20260808 23:36:39.919777 10491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:36:39.920660 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 10491
I20260808 23:36:39.921725 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:37483
--local_ip_for_outbound_sockets=127.26.207.193
--tserver_master_addrs=127.26.207.254:41149
--webserver_port=41417
--webserver_interface=127.26.207.193
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:36:39.927805 10565 sys_catalog.cc:263] Verifying existing consensus state
I20260808 23:36:39.931527 10565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3: Bootstrap starting.
I20260808 23:36:39.958045 10565 log.cc:824] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:39.971637 10565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 23:36:39.972292 10565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3: Bootstrap complete.
I20260808 23:36:39.983330 10565 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } }
I20260808 23:36:39.984371 10565 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fab5cb45fcf43efa58760d8df21fef3, State: Initialized, Role: FOLLOWER
I20260808 23:36:39.985198 10565 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } }
I20260808 23:36:39.985520 10565 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:36:39.985674 10565 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:36:39.985877 10565 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 1 FOLLOWER]: Advancing to term 2
I20260808 23:36:39.990409 10565 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } }
I20260808 23:36:39.991097 10565 leader_election.cc:302] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fab5cb45fcf43efa58760d8df21fef3; no voters:
I20260808 23:36:39.991806 10565 leader_election.cc:288] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 23:36:39.991966 10569 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 23:36:39.993328 10569 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 2 LEADER]: Becoming Leader. State: Replica: 9fab5cb45fcf43efa58760d8df21fef3, State: Running, Role: LEADER
I20260808 23:36:39.994074 10569 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } }
I20260808 23:36:39.994457 10565 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:36:39.997151 10571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fab5cb45fcf43efa58760d8df21fef3. Latest consensus state: current_term: 2 leader_uuid: "9fab5cb45fcf43efa58760d8df21fef3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } } }
I20260808 23:36:39.997980 10571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [sys.catalog]: This master's current role is: LEADER
I20260808 23:36:39.997512 10570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9fab5cb45fcf43efa58760d8df21fef3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } } }
I20260808 23:36:39.998976 10570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [sys.catalog]: This master's current role is: LEADER
I20260808 23:36:39.999567 10577 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:36:40.010044 10577 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:36:40.011802 10577 catalog_manager.cc:1259] Loaded cluster ID: 9bdb331b7a324c00b2d293f3ee4c1f15
I20260808 23:36:40.012012 10577 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:36:40.016274 10577 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 23:36:40.033990 10588 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 23:36:40.036368 10577 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 23:36:40.046674 10577 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:36:40.048529 10577 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3: Loaded TSK: 0
I20260808 23:36:40.050195 10577 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 23:36:40.325019 10567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:40.325373 10567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:40.325479 10567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:40.333667 10567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:40.333845 10567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:40.334049 10567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:36:40.344663 10567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:37483
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=41417
--tserver_master_addrs=127.26.207.254:41149
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:40.346211 10567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:40.347551 10567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:40.362892 10595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:40.362854 10596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:40.363006 10598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:40.364326 10567 server_base.cc:1034] running on GCE node
I20260808 23:36:40.365178 10567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:40.366382 10567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:40.367657 10567 hybrid_clock.cc:648] HybridClock initialized: now 1786232200367611 us; error 49 us; skew 500 ppm
I20260808 23:36:40.367998 10567 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:40 dist-test-slave-1x4g krb5kdc[9878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232200, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:40.371670 10567 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:36:40.373538 10567 webserver.cc:460] Webserver started at http://127.26.207.193:41417/ using document root <none> and password file <none>
I20260808 23:36:40.374514 10567 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:40.374656 10567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:40.380766 10567 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 23:36:40.384095 10605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:40.385897 10567 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:36:40.386101 10567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "4d824b8f79894fccb5162202ca9145f6"
format_stamp: "Formatted at 2026-08-08 23:36:37 on dist-test-slave-1x4g"
server_key: "f9428120ca7fca781664bd54a4b7da1e"
server_key_iv: "34b76a84d4e66985485f6a8af3fdf1e7"
server_key_version: "encryptionkey@0"
I20260808 23:36:40.387236 10567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:40.414583 10567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:40.419343 10567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:40.419641 10567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:40.420748 10567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:36:40.422241 10567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:36:40.422361 10567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:40.422469 10567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:36:40.422564 10567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:40.458616 10567 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:37483
I20260808 23:36:40.458714 10729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:37483 every 8 connection(s)
I20260808 23:36:40.460269 10567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:36:40.469796 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 10567
I20260808 23:36:40.470690 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:34147
--local_ip_for_outbound_sockets=127.26.207.194
--tserver_master_addrs=127.26.207.254:41149
--webserver_port=39687
--webserver_interface=127.26.207.194
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 23:36:40 dist-test-slave-1x4g krb5kdc[9878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232200, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:36:40.489436 10732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:40.463564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:58433 (local address 127.26.207.254:41149)
0808 23:36:40.464188 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:40.464201 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:40.465099 (+ 898us) server_negotiation.cc:407] Connection header received
0808 23:36:40.467381 (+ 2282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:40.467397 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:40.467787 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:40.468137 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:40.469850 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:40.471948 (+ 2098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:40.473903 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:40.475102 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:40.475341 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:40.479469 (+ 4128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:40.479485 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:40.479512 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:40.479585 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:40.483591 (+ 4006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:40.484988 (+ 1397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:40.484996 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:40.485003 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:40.485211 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:40.485818 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:40.485824 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:40.485826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:40.486448 (+ 622us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:40.486629 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:40.487831 (+ 1202us) server_negotiation.cc:299] Negotiation successful
0808 23:36:40.488212 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":273,"threads_started":1}
I20260808 23:36:40.489714 10733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:40.463896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:58433)
0808 23:36:40.464879 (+ 983us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:40.464939 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:40.466773 (+ 1834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:40.468312 (+ 1539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:40.468320 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:40.468966 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:40.469554 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:40.469575 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:40.472163 (+ 2588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:40.472167 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:40.473704 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:40.473720 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:40.475423 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:40.475430 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:40.475647 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:40.476417 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:40.476444 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:40.479047 (+ 2603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:40.483835 (+ 4788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:40.483850 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:40.483873 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:40.484698 (+ 825us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:40.485352 (+ 654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:40.485360 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:40.485367 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:40.485657 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:40.486629 (+ 972us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:40.486642 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:40.487215 (+ 573us) client_negotiation.cc:769] Sending connection context
0808 23:36:40.487569 (+ 354us) client_negotiation.cc:240] Negotiation successful
0808 23:36:40.488244 (+ 675us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"thread_start_us":380,"threads_started":1}
I20260808 23:36:40.493294 10730 heartbeater.cc:347] Connected to a master server at 127.26.207.254:41149
I20260808 23:36:40.493659 10730 heartbeater.cc:464] Registering TS with master...
I20260808 23:36:40.494534 10730 heartbeater.cc:511] Master 127.26.207.254:41149 requested a full tablet report, sending...
I20260808 23:36:40.497589 10527 ts_manager.cc:194] Registered new tserver with Master: 4d824b8f79894fccb5162202ca9145f6 (127.26.207.193:37483)
I20260808 23:36:40.499337 10527 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:58433
W20260808 23:36:40.854260 10734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:40.854593 10734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:40.854753 10734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:40.862792 10734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:40.862933 10734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:40.863124 10734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:36:40.873768 10734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:34147
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=39687
--tserver_master_addrs=127.26.207.254:41149
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:40.875329 10734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:40.876833 10734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:40.891780 10740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:40.891832 10739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:40.891762 10742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:40.892958 10734 server_base.cc:1034] running on GCE node
I20260808 23:36:40.893637 10734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:40.894709 10734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:40.896054 10734 hybrid_clock.cc:648] HybridClock initialized: now 1786232200895926 us; error 87 us; skew 500 ppm
I20260808 23:36:40.896447 10734 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:40 dist-test-slave-1x4g krb5kdc[9878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232200, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:40.900120 10734 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:36:40.902043 10734 webserver.cc:460] Webserver started at http://127.26.207.194:39687/ using document root <none> and password file <none>
I20260808 23:36:40.902932 10734 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:40.903122 10734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:40.909271 10734 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:36:40.912396 10751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:40.913914 10734 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:36:40.914131 10734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "40fa47506b64458bac27e8feb323ec87"
format_stamp: "Formatted at 2026-08-08 23:36:37 on dist-test-slave-1x4g"
server_key: "5c1bc90ff36115d70d81db83c793cae8"
server_key_iv: "506cc3c47ac373e16ad0b446fb2a9d3a"
server_key_version: "encryptionkey@0"
I20260808 23:36:40.915210 10734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:40.949065 10734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:40.953855 10734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:40.954164 10734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:40.955312 10734 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:36:40.957015 10734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:36:40.957160 10734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:40.957317 10734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:36:40.957466 10734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 23:36:40.998871 10734 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:34147
I20260808 23:36:40.998939 10873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:34147 every 8 connection(s)
I20260808 23:36:41.000492 10734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:36:41.010174 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 10734
I20260808 23:36:41.010958 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:38889
--local_ip_for_outbound_sockets=127.26.207.195
--tserver_master_addrs=127.26.207.254:41149
--webserver_port=46179
--webserver_interface=127.26.207.195
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 23:36:41 dist-test-slave-1x4g krb5kdc[9878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232200, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:36:41.028385 10876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.003739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:41461 (local address 127.26.207.254:41149)
0808 23:36:41.004293 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:41.004297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:41.005423 (+ 1126us) server_negotiation.cc:407] Connection header received
0808 23:36:41.007436 (+ 2013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:41.007442 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:41.007545 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:41.007674 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:41.009512 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.010647 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.012634 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.013488 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.013667 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.020219 (+ 6552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:41.020229 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:41.020236 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:41.020296 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:41.024462 (+ 4166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:41.025681 (+ 1219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:41.025686 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:41.025688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:41.025844 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:41.026421 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:41.026424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:41.026426 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:41.026733 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:41.026854 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:41.027885 (+ 1031us) server_negotiation.cc:299] Negotiation successful
0808 23:36:41.028106 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":301,"threads_started":1}
I20260808 23:36:41.030185 10877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.004321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:41461)
0808 23:36:41.005214 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:41.005264 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:41.007108 (+ 1844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:41.007959 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:41.007969 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:41.008562 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:41.009286 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:41.009307 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.010844 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.010848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:41.012408 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:41.012428 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.013779 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.013785 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:41.014038 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.014838 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:41.014864 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:41.019858 (+ 4994us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:41.024735 (+ 4877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:41.024746 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:41.024763 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:41.025499 (+ 736us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:41.025976 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:41.025984 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:41.025991 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:41.026293 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:41.026878 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:41.026890 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:41.027444 (+ 554us) client_negotiation.cc:769] Sending connection context
0808 23:36:41.027786 (+ 342us) client_negotiation.cc:240] Negotiation successful
0808 23:36:41.028520 (+ 734us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":417,"threads_started":1}
I20260808 23:36:41.031953 10874 heartbeater.cc:347] Connected to a master server at 127.26.207.254:41149
I20260808 23:36:41.032323 10874 heartbeater.cc:464] Registering TS with master...
I20260808 23:36:41.033435 10874 heartbeater.cc:511] Master 127.26.207.254:41149 requested a full tablet report, sending...
I20260808 23:36:41.035233 10527 ts_manager.cc:194] Registered new tserver with Master: 40fa47506b64458bac27e8feb323ec87 (127.26.207.194:34147)
I20260808 23:36:41.036126 10527 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:41461
W20260808 23:36:41.384038 10878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:41.384351 10878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:41.384528 10878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:41.392318 10878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:41.392449 10878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:41.392648 10878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:36:41.403596 10878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:38889
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=46179
--tserver_master_addrs=127.26.207.254:41149
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:41.405073 10878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:41.406512 10878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:41.421868 10884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:41.421923 10887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:41.421945 10885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:41.422849 10878 server_base.cc:1034] running on GCE node
I20260808 23:36:41.423578 10878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:41.424671 10878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:41.425944 10878 hybrid_clock.cc:648] HybridClock initialized: now 1786232201425882 us; error 53 us; skew 500 ppm
I20260808 23:36:41.426355 10878 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:41 dist-test-slave-1x4g krb5kdc[9878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232201, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:41.430096 10878 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:36:41.431861 10878 webserver.cc:460] Webserver started at http://127.26.207.195:46179/ using document root <none> and password file <none>
I20260808 23:36:41.432816 10878 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:41.432997 10878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:41.439108 10878 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 23:36:41.442454 10894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:41.444170 10878 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 23:36:41.444373 10878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "ff04239a74cc47b3b34523e8d5db3cf1"
format_stamp: "Formatted at 2026-08-08 23:36:38 on dist-test-slave-1x4g"
server_key: "2fd0a6cf7aa7e413c3e405509f3208c7"
server_key_iv: "8980c90ca242ae4564441cb9c26d4310"
server_key_version: "encryptionkey@0"
I20260808 23:36:41.445601 10878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:41.467092 10878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:41.472026 10878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:41.472289 10878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:41.473522 10878 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:36:41.474984 10878 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:36:41.475080 10878 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:41.475210 10878 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:36:41.475296 10878 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:41.503137 10730 heartbeater.cc:503] Master 127.26.207.254:41149 was elected leader, sending a full tablet report...
I20260808 23:36:41.512202 10878 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:38889
I20260808 23:36:41.512234 11018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:38889 every 8 connection(s)
I20260808 23:36:41.513852 10878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:36:41.520470 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 10878
Aug 08 23:36:41 dist-test-slave-1x4g krb5kdc[9878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232201, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:36:41.537395 11022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.521517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37550 (local address 127.26.207.254:41149)
0808 23:36:41.522088 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:41.522098 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:41.522481 (+ 383us) server_negotiation.cc:407] Connection header received
0808 23:36:41.522630 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:41.522635 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:41.522710 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:41.522833 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:41.524568 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.525727 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.527211 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.527676 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.527821 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.530840 (+ 3019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:41.530845 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:41.530849 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:41.530920 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:41.534304 (+ 3384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:41.535114 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:41.535122 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:41.535126 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:41.535271 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:41.535701 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:41.535706 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:41.535711 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:41.536033 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:41.536323 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:41.536666 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 23:36:41.536954 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":271,"threads_started":1}
I20260808 23:36:41.537740 10876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.516915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:42789 (local address 127.26.207.254:41149)
0808 23:36:41.517150 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:41.517158 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:41.518601 (+ 1443us) server_negotiation.cc:407] Connection header received
0808 23:36:41.520831 (+ 2230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:41.520838 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:41.520960 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:41.521084 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:41.523324 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.524061 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.526406 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.526828 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.526976 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.530967 (+ 3991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:41.530974 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:41.530978 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:41.531042 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:41.534348 (+ 3306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:41.535180 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:41.535186 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:41.535190 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:41.535334 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:41.535812 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:41.535828 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:41.535830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:41.536119 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:41.536295 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:41.537132 (+ 837us) server_negotiation.cc:299] Negotiation successful
0808 23:36:41.537362 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 23:36:41.539265 11021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.517520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:42789)
0808 23:36:41.518381 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:41.518439 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:41.520441 (+ 2002us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:41.521420 (+ 979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:41.521431 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:41.522223 (+ 792us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:36:41.523139 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:41.523163 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.524256 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.524261 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:41.526242 (+ 1981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:41.526255 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.527118 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.527128 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:41.527365 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.528118 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:36:41.528148 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:36:41.530681 (+ 2533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:36:41.534522 (+ 3841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:41.534532 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:41.534553 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:41.535040 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:41.535466 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:36:41.535471 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:36:41.535475 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:36:41.535684 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:36:41.536260 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:36:41.536269 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:36:41.536687 (+ 418us) client_negotiation.cc:769] Sending connection context
0808 23:36:41.537044 (+ 357us) client_negotiation.cc:240] Negotiation successful
0808 23:36:41.537644 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":405,"threads_started":1}
I20260808 23:36:41.541126 11019 heartbeater.cc:347] Connected to a master server at 127.26.207.254:41149
I20260808 23:36:41.541422 11019 heartbeater.cc:464] Registering TS with master...
I20260808 23:36:41.542189 11019 heartbeater.cc:511] Master 127.26.207.254:41149 requested a full tablet report, sending...
I20260808 23:36:41.543784 10525 ts_manager.cc:194] Registered new tserver with Master: ff04239a74cc47b3b34523e8d5db3cf1 (127.26.207.195:38889)
I20260808 23:36:41.544819 10525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:42789
I20260808 23:36:41.553401 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:36:41.560961 10876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.554490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37562 (local address 127.26.207.254:41149)
0808 23:36:41.554678 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:41.554683 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:41.555230 (+ 547us) server_negotiation.cc:407] Connection header received
0808 23:36:41.555450 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:41.555454 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:41.555616 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:41.555758 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:36:41.556218 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.557078 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.558626 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.559090 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.559193 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.559751 (+ 558us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:36:41.560311 (+ 560us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:36:41.560434 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:41.560563 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 23:36:41.560640 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 23:36:41.562069 10525 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:37562:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:36:41.570235 10525 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:36:41.611335 11031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.584624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33764 (local address 127.26.207.194:34147)
0808 23:36:41.599394 (+ 14770us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:41.599410 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:41.599456 (+ 46us) server_negotiation.cc:407] Connection header received
0808 23:36:41.599607 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:41.599621 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:41.600009 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:41.601563 (+ 1554us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:36:41.602956 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.604621 (+ 1665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.607828 (+ 3207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.609478 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.609688 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.610405 (+ 717us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:41.610507 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 23:36:41.610707 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14556,"thread_start_us":14390,"threads_started":1}
I20260808 23:36:41.611572 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.584358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:34147 (local address 127.0.0.1:33764)
0808 23:36:41.585354 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:41.585403 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:41.585629 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:41.600454 (+ 14825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:41.600468 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:41.600524 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:36:41.601233 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:41.601254 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.604825 (+ 3571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.604831 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:41.607598 (+ 2767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:41.607616 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.609715 (+ 2099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.609721 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:41.609935 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.609995 (+ 60us) client_negotiation.cc:769] Sending connection context
0808 23:36:41.610136 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 23:36:41.611115 (+ 979us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"mutex_wait_us":28,"thread_start_us":505,"threads_started":1}
I20260808 23:36:41.612488 11034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.584907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:38889 (local address 127.0.0.1:54582)
0808 23:36:41.598026 (+ 13119us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:41.598058 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:41.598276 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:41.604261 (+ 5985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:41.604275 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:41.604300 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:36:41.604710 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:41.604723 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.607038 (+ 2315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.607045 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:41.609161 (+ 2116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:41.609184 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.611541 (+ 2357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.611552 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:41.611742 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.611793 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 23:36:41.611886 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 23:36:41.612037 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12891,"mutex_wait_us":3,"thread_start_us":19042,"threads_started":1}
I20260808 23:36:41.612751 11035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.586536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59710 (local address 127.26.207.193:37483)
0808 23:36:41.603576 (+ 17040us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:41.603600 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:41.604453 (+ 853us) server_negotiation.cc:407] Connection header received
0808 23:36:41.604627 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:41.604636 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:41.604928 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:41.605162 (+ 234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:36:41.606188 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.607767 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.609757 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.611262 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.611474 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.611655 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:41.612231 (+ 576us) server_negotiation.cc:299] Negotiation successful
0808 23:36:41.612411 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16841,"thread_start_us":17039,"threads_started":1}
I20260808 23:36:41.612699 11032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.586125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:37483 (local address 127.0.0.1:59710)
0808 23:36:41.604287 (+ 18162us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:41.604309 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:41.604454 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:41.605161 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:41.605166 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:41.605199 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:36:41.605667 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:41.605681 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.607920 (+ 2239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.607929 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:41.609522 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:41.609537 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.611822 (+ 2285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.611829 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:41.612020 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.612049 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 23:36:41.612143 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 23:36:41.612288 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17996,"mutex_wait_us":2,"thread_start_us":11467,"threads_started":1}
I20260808 23:36:41.613467 11033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.585624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54582 (local address 127.26.207.195:38889)
0808 23:36:41.603103 (+ 17479us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:41.603117 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:41.603167 (+ 50us) server_negotiation.cc:407] Connection header received
0808 23:36:41.603306 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:41.603318 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:41.603680 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:41.603950 (+ 270us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:36:41.604990 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.606886 (+ 1896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.609375 (+ 2489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.610930 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.611148 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.611336 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:41.612901 (+ 1565us) server_negotiation.cc:299] Negotiation successful
0808 23:36:41.613085 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16882,"thread_start_us":16548,"threads_started":1}
I20260808 23:36:41.616436 10802 tablet_service.cc:1467] Processing CreateTablet for tablet f3c066ec4aee47818e4cd56f2a7c6c4b (DEFAULT_TABLE table=test-table [id=f15e5cbf3573406caec4d8e757769eda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:36:41.616959 10657 tablet_service.cc:1467] Processing CreateTablet for tablet f3c066ec4aee47818e4cd56f2a7c6c4b (DEFAULT_TABLE table=test-table [id=f15e5cbf3573406caec4d8e757769eda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:36:41.617442 10945 tablet_service.cc:1467] Processing CreateTablet for tablet f3c066ec4aee47818e4cd56f2a7c6c4b (DEFAULT_TABLE table=test-table [id=f15e5cbf3573406caec4d8e757769eda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:36:41.618745 10657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3c066ec4aee47818e4cd56f2a7c6c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:36:41.618836 10945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3c066ec4aee47818e4cd56f2a7c6c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:36:41.618798 10802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3c066ec4aee47818e4cd56f2a7c6c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:36:41.634395 11036 tablet_bootstrap.cc:492] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6: Bootstrap starting.
I20260808 23:36:41.637602 11037 tablet_bootstrap.cc:492] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87: Bootstrap starting.
I20260808 23:36:41.638929 11038 tablet_bootstrap.cc:492] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1: Bootstrap starting.
I20260808 23:36:41.639384 11036 tablet_bootstrap.cc:654] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6: Neither blocks nor log segments found. Creating new log.
I20260808 23:36:41.641007 11036 log.cc:824] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:41.641784 11037 tablet_bootstrap.cc:654] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87: Neither blocks nor log segments found. Creating new log.
I20260808 23:36:41.642414 11038 tablet_bootstrap.cc:654] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1: Neither blocks nor log segments found. Creating new log.
I20260808 23:36:41.643363 11037 log.cc:824] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:41.643617 11038 log.cc:824] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:41.647083 11038 tablet_bootstrap.cc:492] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1: No bootstrap required, opened a new log
I20260808 23:36:41.647236 11037 tablet_bootstrap.cc:492] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87: No bootstrap required, opened a new log
I20260808 23:36:41.647235 11036 tablet_bootstrap.cc:492] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6: No bootstrap required, opened a new log
I20260808 23:36:41.647478 11038 ts_tablet_manager.cc:1397] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.002s
I20260808 23:36:41.647535 11037 ts_tablet_manager.cc:1397] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 23:36:41.647535 11036 ts_tablet_manager.cc:1397] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.000s
I20260808 23:36:41.656219 11038 raft_consensus.cc:348] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } }
I20260808 23:36:41.656728 11038 raft_consensus.cc:374] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:36:41.656913 11038 raft_consensus.cc:729] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff04239a74cc47b3b34523e8d5db3cf1, State: Initialized, Role: FOLLOWER
I20260808 23:36:41.657629 11038 consensus_queue.cc:260] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } }
I20260808 23:36:41.658898 11019 heartbeater.cc:503] Master 127.26.207.254:41149 was elected leader, sending a full tablet report...
I20260808 23:36:41.659670 11038 ts_tablet_manager.cc:1428] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1: Time spent starting tablet: real 0.012s user 0.007s sys 0.005s
I20260808 23:36:41.659355 11036 raft_consensus.cc:348] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } }
I20260808 23:36:41.659355 11037 raft_consensus.cc:348] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } }
I20260808 23:36:41.659833 11037 raft_consensus.cc:374] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:36:41.659833 11036 raft_consensus.cc:374] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:36:41.659933 11036 raft_consensus.cc:729] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d824b8f79894fccb5162202ca9145f6, State: Initialized, Role: FOLLOWER
I20260808 23:36:41.659933 11037 raft_consensus.cc:729] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fa47506b64458bac27e8feb323ec87, State: Initialized, Role: FOLLOWER
I20260808 23:36:41.660580 11037 consensus_queue.cc:260] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } }
I20260808 23:36:41.660593 11036 consensus_queue.cc:260] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } }
I20260808 23:36:41.662650 11037 ts_tablet_manager.cc:1428] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260808 23:36:41.662889 11036 ts_tablet_manager.cc:1428] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260808 23:36:41.663280 10874 heartbeater.cc:503] Master 127.26.207.254:41149 was elected leader, sending a full tablet report...
W20260808 23:36:41.713157 10731 tablet.cc:2369] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:36:41.752995 10875 tablet.cc:2369] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:36:41.765700 11020 tablet.cc:2369] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:36:41.820669 11042 raft_consensus.cc:482] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:36:41.821060 11042 raft_consensus.cc:504] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } }
I20260808 23:36:41.822845 11042 leader_election.cc:288] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40fa47506b64458bac27e8feb323ec87 (127.26.207.194:34147), 4d824b8f79894fccb5162202ca9145f6 (127.26.207.193:37483)
I20260808 23:36:41.828816 11021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.823286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:34147 (local address 127.26.207.195:45641)
0808 23:36:41.823535 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:41.823558 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:41.823703 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:41.824078 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:41.824085 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:41.824114 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:36:41.824301 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:41.824308 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.825466 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.825471 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:41.826768 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:41.826784 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.827971 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.827977 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:41.828215 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.828241 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 23:36:41.828354 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 23:36:41.828497 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66,"mutex_wait_us":23}
I20260808 23:36:41.828835 11031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.823361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:45641 (local address 127.26.207.194:34147)
0808 23:36:41.823579 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:41.823587 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:41.823615 (+ 28us) server_negotiation.cc:407] Connection header received
0808 23:36:41.823858 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:41.823870 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:41.823931 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:41.824028 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:36:41.824449 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.825285 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.827002 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.827802 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.827977 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.828057 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:41.828385 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 23:36:41.828528 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 23:36:41.829890 10826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3c066ec4aee47818e4cd56f2a7c6c4b" candidate_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fa47506b64458bac27e8feb323ec87" is_pre_election: true
I20260808 23:36:41.830356 11035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.824019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:38205 (local address 127.26.207.193:37483)
0808 23:36:41.824226 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:41.824234 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:41.824725 (+ 491us) server_negotiation.cc:407] Connection header received
0808 23:36:41.824949 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:41.824959 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:41.825039 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:41.825146 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:36:41.825705 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.826434 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.828341 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.829413 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.829603 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.829677 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:41.829951 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 23:36:41.830102 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 23:36:41.830479 11045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.823749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:37483 (local address 127.26.207.195:38205)
0808 23:36:41.824596 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:41.824615 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:36:41.824769 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:36:41.825163 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:36:41.825168 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:36:41.825190 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:36:41.825536 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:41.825545 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.826613 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.826623 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:41.828159 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:36:41.828175 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.829618 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.829624 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:36:41.829784 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.829807 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 23:36:41.829929 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 23:36:41.830083 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":756,"mutex_wait_us":24,"thread_start_us":531,"threads_started":1}
I20260808 23:36:41.830507 10826 raft_consensus.cc:2454] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff04239a74cc47b3b34523e8d5db3cf1 in term 0.
I20260808 23:36:41.831261 10895 leader_election.cc:302] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fa47506b64458bac27e8feb323ec87, ff04239a74cc47b3b34523e8d5db3cf1; no voters:
I20260808 23:36:41.831722 11042 raft_consensus.cc:2781] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:36:41.831895 11042 raft_consensus.cc:482] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:36:41.831720 10682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3c066ec4aee47818e4cd56f2a7c6c4b" candidate_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d824b8f79894fccb5162202ca9145f6" is_pre_election: true
I20260808 23:36:41.832017 11042 raft_consensus.cc:3037] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:36:41.832366 10682 raft_consensus.cc:2454] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff04239a74cc47b3b34523e8d5db3cf1 in term 0.
I20260808 23:36:41.834595 11042 raft_consensus.cc:504] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } }
I20260808 23:36:41.835183 11042 leader_election.cc:288] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [CANDIDATE]: Term 1 election: Requested vote from peers 40fa47506b64458bac27e8feb323ec87 (127.26.207.194:34147), 4d824b8f79894fccb5162202ca9145f6 (127.26.207.193:37483)
I20260808 23:36:41.835791 10826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3c066ec4aee47818e4cd56f2a7c6c4b" candidate_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40fa47506b64458bac27e8feb323ec87"
I20260808 23:36:41.835886 10682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3c066ec4aee47818e4cd56f2a7c6c4b" candidate_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d824b8f79894fccb5162202ca9145f6"
I20260808 23:36:41.836030 10826 raft_consensus.cc:3037] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:36:41.836172 10682 raft_consensus.cc:3037] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:36:41.838557 10682 raft_consensus.cc:2454] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff04239a74cc47b3b34523e8d5db3cf1 in term 1.
I20260808 23:36:41.838558 10826 raft_consensus.cc:2454] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff04239a74cc47b3b34523e8d5db3cf1 in term 1.
I20260808 23:36:41.839041 10895 leader_election.cc:302] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40fa47506b64458bac27e8feb323ec87, ff04239a74cc47b3b34523e8d5db3cf1; no voters:
I20260808 23:36:41.839395 11042 raft_consensus.cc:2781] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:36:41.839898 11042 raft_consensus.cc:686] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [term 1 LEADER]: Becoming Leader. State: Replica: ff04239a74cc47b3b34523e8d5db3cf1, State: Running, Role: LEADER
I20260808 23:36:41.840552 11042 consensus_queue.cc:237] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } } peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } }
I20260808 23:36:41.845498 10525 catalog_manager.cc:5495] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff04239a74cc47b3b34523e8d5db3cf1 (127.26.207.195). New cstate: current_term: 1 leader_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff04239a74cc47b3b34523e8d5db3cf1" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 38889 } health_report { overall_health: HEALTHY } } }
I20260808 23:36:41.912166 11033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.906205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54594 (local address 127.26.207.195:38889)
0808 23:36:41.906436 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:41.906442 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:41.906481 (+ 39us) server_negotiation.cc:407] Connection header received
0808 23:36:41.906720 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:41.906724 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:41.906807 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:41.906974 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:36:41.907408 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.908138 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.909835 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.910278 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.910425 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.910986 (+ 561us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:36:41.911540 (+ 554us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:36:41.911729 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:41.911783 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 23:36:41.911875 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 23:36:41.922024 10826 raft_consensus.cc:1261] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87 [term 1 FOLLOWER]: Refusing update from remote peer ff04239a74cc47b3b34523e8d5db3cf1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:36:41.922106 10682 raft_consensus.cc:1261] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6 [term 1 FOLLOWER]: Refusing update from remote peer ff04239a74cc47b3b34523e8d5db3cf1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:36:41.923190 11046 consensus_queue.cc:1035] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40fa47506b64458bac27e8feb323ec87" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:36:41.923629 11042 consensus_queue.cc:1035] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d824b8f79894fccb5162202ca9145f6" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 37483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:36:41.941943 11048 mvcc.cc:205] Tried to move back new op lower bound from 7316407099060559872 to 7316407098743795712. Current Snapshot: MvccSnapshot[applied={T|T < 7316407099060559872}]
I20260808 23:36:41.959635 10525 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:37562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:36:41.959933 10525 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:37562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:36:41.965138 10525 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3: Sending DeleteTablet for 3 replicas of tablet f3c066ec4aee47818e4cd56f2a7c6c4b
I20260808 23:36:41.966733 10945 tablet_service.cc:1514] Processing DeleteTablet for tablet f3c066ec4aee47818e4cd56f2a7c6c4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:36:41 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:54582
I20260808 23:36:41.966723 10802 tablet_service.cc:1514] Processing DeleteTablet for tablet f3c066ec4aee47818e4cd56f2a7c6c4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:36:41 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:33764
I20260808 23:36:41.966815 10657 tablet_service.cc:1514] Processing DeleteTablet for tablet f3c066ec4aee47818e4cd56f2a7c6c4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:36:41 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:59710
I20260808 23:36:41.968365 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 10567
I20260808 23:36:41.980196 11060 tablet_replica.cc:330] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6: stopping tablet replica
I20260808 23:36:41.981564 11060 raft_consensus.cc:2229] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:36:41.982113 11061 tablet_replica.cc:330] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87: stopping tablet replica
I20260808 23:36:41.982295 11060 raft_consensus.cc:2258] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:36:41.982645 11059 tablet_replica.cc:330] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1: stopping tablet replica
I20260808 23:36:41.983078 11061 raft_consensus.cc:2229] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:36:41.983150 11059 raft_consensus.cc:2229] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:36:41.983738 11061 raft_consensus.cc:2258] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:36:41.985322 11059 raft_consensus.cc:2258] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:36:41.985435 11060 ts_tablet_manager.cc:1905] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:36:41.985819 11061 ts_tablet_manager.cc:1905] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:36:41.991508 11035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:41.969356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59712 (local address 127.26.207.193:37483)
0808 23:36:41.969567 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:41.969575 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:41.970042 (+ 467us) server_negotiation.cc:407] Connection header received
0808 23:36:41.970120 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:41.970127 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:41.970229 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:41.970330 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:41.972539 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.973896 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.976174 (+ 2278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:41.976988 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:41.977135 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:41.982186 (+ 5051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:41.982205 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:41.982227 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:41.982299 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:41.986925 (+ 4626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:41.988166 (+ 1241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:41.988177 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:41.988181 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:41.988411 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:41.989038 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:41.989044 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:41.989048 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:41.989599 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:41.989979 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:41.990715 (+ 736us) server_negotiation.cc:299] Negotiation successful
0808 23:36:41.991033 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 23:36:41.993503 10725 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:41.993566 11060 ts_tablet_manager.cc:1918] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:36:41.993561 11061 ts_tablet_manager.cc:1918] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:36:41.993757 11061 log.cc:1196] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/f3c066ec4aee47818e4cd56f2a7c6c4b
I20260808 23:36:41.993793 11060 log.cc:1196] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/f3c066ec4aee47818e4cd56f2a7c6c4b
I20260808 23:36:41.994491 11061 ts_tablet_manager.cc:1939] T f3c066ec4aee47818e4cd56f2a7c6c4b P 40fa47506b64458bac27e8feb323ec87: Deleting consensus metadata
I20260808 23:36:41.996807 10509 catalog_manager.cc:4841] TS 40fa47506b64458bac27e8feb323ec87 (127.26.207.194:34147): tablet f3c066ec4aee47818e4cd56f2a7c6c4b (table test-table [id=f15e5cbf3573406caec4d8e757769eda]) successfully deleted
I20260808 23:36:42.000140 11059 ts_tablet_manager.cc:1905] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:36:42.008944 11059 ts_tablet_manager.cc:1918] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:36:42.009311 11059 log.cc:1196] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/f3c066ec4aee47818e4cd56f2a7c6c4b
I20260808 23:36:42.010066 11059 ts_tablet_manager.cc:1939] T f3c066ec4aee47818e4cd56f2a7c6c4b P ff04239a74cc47b3b34523e8d5db3cf1: Deleting consensus metadata
I20260808 23:36:42.012225 10511 catalog_manager.cc:4841] TS ff04239a74cc47b3b34523e8d5db3cf1 (127.26.207.195:38889): tablet f3c066ec4aee47818e4cd56f2a7c6c4b (table test-table [id=f15e5cbf3573406caec4d8e757769eda]) successfully deleted
I20260808 23:36:42.102483 11060 ts_tablet_manager.cc:1939] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6: Deleting consensus metadata
I20260808 23:36:42.102617 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 10567
I20260808 23:36:42.124997 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 10734
W20260808 23:36:42.125089 10509 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.207.193:37483 (error 108)
I20260808 23:36:42.127388 11064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:42.126564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:37483 (local address 127.0.0.1:59716)
0808 23:36:42.127025 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:42.127168 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:37483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":646,"threads_started":1}
W20260808 23:36:42.127753 10509 catalog_manager.cc:4584] TS 4d824b8f79894fccb5162202ca9145f6 (127.26.207.193:37483): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f3c066ec4aee47818e4cd56f2a7c6c4b: Network error: Client connection negotiation failed: client connection to 127.26.207.193:37483: connect: Connection refused (error 111)
I20260808 23:36:42.142369 11031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:42.125969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33778 (local address 127.26.207.194:34147)
0808 23:36:42.126176 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:42.126183 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:42.126751 (+ 568us) server_negotiation.cc:407] Connection header received
0808 23:36:42.126849 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:42.126856 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:42.126953 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:42.127074 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:42.129001 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:42.129799 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:42.131731 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:42.132140 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:42.132332 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:42.135926 (+ 3594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:42.135944 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:42.135960 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:42.135998 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:42.139118 (+ 3120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:42.140121 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:42.140129 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:42.140132 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:42.140266 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:42.140713 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:42.140716 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:42.140718 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:42.141221 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:42.141459 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:42.141836 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 23:36:42.142025 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 23:36:42.143142 10869 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:42.181849 11064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:42.181247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:37483 (local address 127.0.0.1:59732)
0808 23:36:42.181513 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:42.181660 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:37483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260808 23:36:42.183096 11064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:42.182675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:37483 (local address 127.0.0.1:59742)
0808 23:36:42.182847 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:42.182950 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:37483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 23:36:42.238530 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 10734
I20260808 23:36:42.244007 11064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:42.243378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:37483 (local address 127.0.0.1:59746)
0808 23:36:42.243646 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:42.243772 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:37483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260808 23:36:42.245467 11064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:42.244969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:37483 (local address 127.0.0.1:59760)
0808 23:36:42.245161 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:42.245275 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:37483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 23:36:42.262292 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 10878
I20260808 23:36:42.278358 11033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:42.263188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54602 (local address 127.26.207.195:38889)
0808 23:36:42.263367 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:42.263374 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:42.263459 (+ 85us) server_negotiation.cc:407] Connection header received
0808 23:36:42.263680 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:42.263689 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:42.263784 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:42.263911 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:42.265439 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:42.266241 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:42.267597 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:42.268084 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:42.268235 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:42.271298 (+ 3063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:42.271313 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:42.271329 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:42.271382 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:42.274952 (+ 3570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:42.275817 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:42.275826 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:42.275828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:42.276016 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:42.276480 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:42.276485 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:42.276498 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:42.276994 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:42.277339 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:42.277688 (+ 349us) server_negotiation.cc:299] Negotiation successful
0808 23:36:42.277931 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 23:36:42.279119 11012 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:42.326972 11064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:42.326417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:37483 (local address 127.0.0.1:59762)
0808 23:36:42.326692 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:42.326797 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:37483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
I20260808 23:36:42.328225 11064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:42.327795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:37483 (local address 127.0.0.1:59778)
0808 23:36:42.328005 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:42.328082 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:37483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260808 23:36:42.409976 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 10878
I20260808 23:36:42.436648 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 10491
I20260808 23:36:42.438053 10560 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:42.556551 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 10491
I20260808 23:36:42.556597 11064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:42.556061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:37483 (local address 127.0.0.1:59794)
0808 23:36:42.556292 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:42.556425 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:37483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 23:36:42.584996 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:41149
--webserver_interface=127.26.207.254
--webserver_port=35115
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:41149
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:36:42.964764 11068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:42.965337 11068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:42.965564 11068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:42.975023 11068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:36:42.975227 11068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:42.975343 11068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:42.975456 11068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:36:42.975549 11068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:36:42.986585 11068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:41149
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:41149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=35115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:42.988171 11068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:42.989710 11068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:43.004027 11076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:43.004029 11074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:43.004334 11073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:43.005050 11068 server_base.cc:1034] running on GCE node
I20260808 23:36:43.006001 11068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:43.007761 11068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:43.008981 11068 hybrid_clock.cc:648] HybridClock initialized: now 1786232203008911 us; error 80 us; skew 500 ppm
I20260808 23:36:43.009406 11068 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:43 dist-test-slave-1x4g krb5kdc[9878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232203, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:43.012879 11068 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:36:43.014569 11068 webserver.cc:460] Webserver started at http://127.26.207.254:35115/ using document root <none> and password file <none>
I20260808 23:36:43.015385 11068 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:43.015558 11068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:43.022071 11068 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:36:43.027849 11083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:43.029485 11068 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 23:36:43.029721 11068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "9fab5cb45fcf43efa58760d8df21fef3"
format_stamp: "Formatted at 2026-08-08 23:36:36 on dist-test-slave-1x4g"
server_key: "90ec34f501b65e63b400828a4e3866e4"
server_key_iv: "1514d349e5728cd48c686a0d369886c9"
server_key_version: "encryptionkey@0"
I20260808 23:36:43.030855 11068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:43.052659 11068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:43.057430 11068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:43.057802 11068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:43.078890 11068 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:41149
I20260808 23:36:43.078909 11139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:41149 every 8 connection(s)
I20260808 23:36:43.080657 11068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:36:43.088274 11140 sys_catalog.cc:263] Verifying existing consensus state
I20260808 23:36:43.088413 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 11068
I20260808 23:36:43.089406 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:37483
--local_ip_for_outbound_sockets=127.26.207.193
--tserver_master_addrs=127.26.207.254:41149
--webserver_port=41417
--webserver_interface=127.26.207.193
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:36:43.092337 11140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3: Bootstrap starting.
I20260808 23:36:43.118750 11140 log.cc:824] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3: Log is configured to *not* fsync() on all Append() calls
I20260808 23:36:43.144129 11140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 23:36:43.144979 11140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3: Bootstrap complete.
I20260808 23:36:43.159160 11140 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } }
I20260808 23:36:43.160641 11140 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fab5cb45fcf43efa58760d8df21fef3, State: Initialized, Role: FOLLOWER
I20260808 23:36:43.161595 11140 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } }
I20260808 23:36:43.161957 11140 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:36:43.162108 11140 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:36:43.162315 11140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 2 FOLLOWER]: Advancing to term 3
I20260808 23:36:43.168716 11140 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } }
I20260808 23:36:43.169579 11140 leader_election.cc:302] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fab5cb45fcf43efa58760d8df21fef3; no voters:
I20260808 23:36:43.170503 11140 leader_election.cc:288] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 23:36:43.170648 11144 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 23:36:43.172462 11144 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [term 3 LEADER]: Becoming Leader. State: Replica: 9fab5cb45fcf43efa58760d8df21fef3, State: Running, Role: LEADER
I20260808 23:36:43.173251 11144 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } }
I20260808 23:36:43.173553 11140 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:36:43.176215 11145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "9fab5cb45fcf43efa58760d8df21fef3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } } }
I20260808 23:36:43.176192 11146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fab5cb45fcf43efa58760d8df21fef3. Latest consensus state: current_term: 3 leader_uuid: "9fab5cb45fcf43efa58760d8df21fef3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fab5cb45fcf43efa58760d8df21fef3" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 41149 } } }
I20260808 23:36:43.176705 11146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [sys.catalog]: This master's current role is: LEADER
I20260808 23:36:43.177670 11145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fab5cb45fcf43efa58760d8df21fef3 [sys.catalog]: This master's current role is: LEADER
I20260808 23:36:43.186546 11151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:36:43.196660 11151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:36:43.198572 11151 catalog_manager.cc:1259] Loaded cluster ID: 9bdb331b7a324c00b2d293f3ee4c1f15
I20260808 23:36:43.198729 11151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 23:36:43.200459 11151 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f20fdb299ad google::LogMessage::Fail() at ??:0
@ 0x7f20fdb2c88a google::LogMessage::SendToLog() at ??:0
@ 0x7f20fdb294de google::LogMessage::Flush() at ??:0
@ 0x7f20fdb2aa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f211355c512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f2113559976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f21135e1610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f21135e1439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f2100775345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f210077891c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f2100778799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f2100753eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2103a2d6db start_thread at ??:0
@ 0x7f20fc9c361f clone at ??:0
W20260808 23:36:43.566583 11142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:43.566919 11142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:43.567034 11142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:43.574764 11142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:43.574898 11142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:43.575039 11142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:36:43.585325 11142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:37483
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=41417
--tserver_master_addrs=127.26.207.254:41149
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:43.586719 11142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:43.588099 11142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:43.604168 11183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:43.604092 11184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:43.604126 11186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:43.605284 11142 server_base.cc:1034] running on GCE node
I20260808 23:36:43.606084 11142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:43.607275 11142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:43.608515 11142 hybrid_clock.cc:648] HybridClock initialized: now 1786232203608457 us; error 47 us; skew 500 ppm
I20260808 23:36:43.608953 11142 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:43 dist-test-slave-1x4g krb5kdc[9878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232203, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:43.613227 11142 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:36:43.615041 11142 webserver.cc:460] Webserver started at http://127.26.207.193:41417/ using document root <none> and password file <none>
I20260808 23:36:43.615821 11142 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:43.615940 11142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:43.622584 11142 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 23:36:43.625829 11193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:43.627532 11142 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:36:43.627767 11142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "4d824b8f79894fccb5162202ca9145f6"
format_stamp: "Formatted at 2026-08-08 23:36:37 on dist-test-slave-1x4g"
server_key: "f9428120ca7fca781664bd54a4b7da1e"
server_key_iv: "34b76a84d4e66985485f6a8af3fdf1e7"
server_key_version: "encryptionkey@0"
I20260808 23:36:43.628985 11142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:43.647610 11142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:43.652602 11142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:43.652980 11142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:43.654155 11142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:36:43.656199 11201 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260808 23:36:43.662274 11201 ts_tablet_manager.cc:1852] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260808 23:36:43.663354 11201 ts_tablet_manager.cc:1905] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:36:43.671784 11201 ts_tablet_manager.cc:1918] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:36:43.672101 11201 ts_tablet_manager.cc:1939] T f3c066ec4aee47818e4cd56f2a7c6c4b P 4d824b8f79894fccb5162202ca9145f6: Deleting consensus metadata
I20260808 23:36:43.672626 11142 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260808 23:36:43.672861 11142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.017s user 0.001s sys 0.000s
I20260808 23:36:43.673054 11142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:36:43.673159 11142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:43.713658 11142 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:37483
I20260808 23:36:43.713771 11315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:37483 every 8 connection(s)
I20260808 23:36:43.715255 11142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:36:43.721446 11318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:43.719056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:53095)
0808 23:36:43.719935 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:43.720256 (+ 321us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":351,"threads_started":1}
W20260808 23:36:43.722325 11316 heartbeater.cc:644] Failed to heartbeat to 127.26.207.254:41149 (0 consecutive failures): Network error: Failed to ping master at 127.26.207.254:41149: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
I20260808 23:36:43.722779 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 11142
I20260808 23:36:43.723446 11318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:43.723028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:56009)
0808 23:36:43.723219 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:43.723319 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 23:36:43.723470 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:34147
--local_ip_for_outbound_sockets=127.26.207.194
--tserver_master_addrs=127.26.207.254:41149
--webserver_port=39687
--webserver_interface=127.26.207.194
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:36:43.724469 11318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:43.724064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:54811)
0808 23:36:43.724231 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:43.724328 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 23:36:43.724730 11316 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 23:36:44.108476 11319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:44.108922 11319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:44.109095 11319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:44.117482 11319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:44.117684 11319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:44.117869 11319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:36:44.129199 11319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:34147
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=39687
--tserver_master_addrs=127.26.207.254:41149
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:44.130700 11319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:44.132331 11319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:44.147454 11325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:44.147445 11326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:44.147562 11328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:44.148281 11319 server_base.cc:1034] running on GCE node
I20260808 23:36:44.149047 11319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:44.150043 11319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:44.151271 11319 hybrid_clock.cc:648] HybridClock initialized: now 1786232204151224 us; error 33 us; skew 500 ppm
I20260808 23:36:44.151659 11319 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:44 dist-test-slave-1x4g krb5kdc[9878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232204, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:44.155089 11319 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:36:44.156755 11319 webserver.cc:460] Webserver started at http://127.26.207.194:39687/ using document root <none> and password file <none>
I20260808 23:36:44.157575 11319 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:44.157735 11319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:44.163839 11319 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.006s
I20260808 23:36:44.167217 11335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:44.169049 11319 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260808 23:36:44.169324 11319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "40fa47506b64458bac27e8feb323ec87"
format_stamp: "Formatted at 2026-08-08 23:36:37 on dist-test-slave-1x4g"
server_key: "5c1bc90ff36115d70d81db83c793cae8"
server_key_iv: "506cc3c47ac373e16ad0b446fb2a9d3a"
server_key_version: "encryptionkey@0"
I20260808 23:36:44.170535 11319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:44.186033 11319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:44.190891 11319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:44.191237 11319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:44.192384 11319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:36:44.194661 11319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:36:44.195111 11319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:44.195303 11319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:36:44.195410 11319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:44.234911 11319 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:34147
I20260808 23:36:44.235014 11458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:34147 every 8 connection(s)
I20260808 23:36:44.236650 11319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:36:44.237308 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 11319
I20260808 23:36:44.238281 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:38889
--local_ip_for_outbound_sockets=127.26.207.195
--tserver_master_addrs=127.26.207.254:41149
--webserver_port=46179
--webserver_interface=127.26.207.195
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:36:44.242916 11462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:44.240195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:59005)
0808 23:36:44.241253 (+ 1058us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:44.241582 (+ 329us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":361,"threads_started":1}
W20260808 23:36:44.243731 11459 heartbeater.cc:644] Failed to heartbeat to 127.26.207.254:41149 (0 consecutive failures): Network error: Failed to ping master at 127.26.207.254:41149: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
I20260808 23:36:44.244959 11462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:44.244360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:42913)
0808 23:36:44.244600 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:44.244730 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 23:36:44.246274 11462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:44.245703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:33957)
0808 23:36:44.245931 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:44.246074 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260808 23:36:44.246649 11459 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 23:36:44.598453 11463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:36:44.598840 11463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:36:44.599025 11463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:36:44.606689 11463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:36:44.606873 11463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:36:44.607072 11463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:36:44.617426 11463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:38889
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=46179
--tserver_master_addrs=127.26.207.254:41149
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:36:44.619041 11463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:36:44.620501 11463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:36:44.635542 11469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:44.635686 11468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:36:44.635655 11471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:36:44.636714 11463 server_base.cc:1034] running on GCE node
I20260808 23:36:44.637521 11463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:36:44.638595 11463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:36:44.639847 11463 hybrid_clock.cc:648] HybridClock initialized: now 1786232204639778 us; error 63 us; skew 500 ppm
I20260808 23:36:44.640198 11463 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:36:44 dist-test-slave-1x4g krb5kdc[9878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232204, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:36:44.643639 11463 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:36:44.645546 11463 webserver.cc:460] Webserver started at http://127.26.207.195:46179/ using document root <none> and password file <none>
I20260808 23:36:44.646347 11463 fs_manager.cc:359] Metadata directory not provided
I20260808 23:36:44.646523 11463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:36:44.652537 11463 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 23:36:44.655622 11479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:44.657259 11463 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:36:44.657469 11463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "ff04239a74cc47b3b34523e8d5db3cf1"
format_stamp: "Formatted at 2026-08-08 23:36:38 on dist-test-slave-1x4g"
server_key: "2fd0a6cf7aa7e413c3e405509f3208c7"
server_key_iv: "8980c90ca242ae4564441cb9c26d4310"
server_key_version: "encryptionkey@0"
I20260808 23:36:44.658608 11463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:36:44.674062 11463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:36:44.679117 11463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:36:44.679442 11463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:36:44.680552 11463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:36:44.682166 11463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:36:44.682294 11463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:44.682435 11463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:36:44.682526 11463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:36:44.719556 11463 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:38889
I20260808 23:36:44.719611 11600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:38889 every 8 connection(s)
I20260808 23:36:44.721140 11463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:36:44.722842 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 11463
I20260808 23:36:44.726356 11605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:44.725495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:46505)
0808 23:36:44.726003 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:44.726117 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":265,"threads_started":1}
I20260808 23:36:44.728192 11604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:44.724629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:57583)
0808 23:36:44.727013 (+ 2384us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:44.727259 (+ 246us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2105,"thread_start_us":1865,"threads_started":1}
W20260808 23:36:44.729128 11601 heartbeater.cc:644] Failed to heartbeat to 127.26.207.254:41149 (0 consecutive failures): Network error: Failed to ping master at 127.26.207.254:41149: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
I20260808 23:36:44.730142 11604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:44.729739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:56327)
0808 23:36:44.729906 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:44.729992 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 23:36:44.731150 11604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:44.730779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:40375)
0808 23:36:44.730932 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:44.731026 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 23:36:44.731415 11601 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 23:36:45.248179 11607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:45.247215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:41857)
0808 23:36:45.247794 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:45.247938 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":321,"threads_started":1}
I20260808 23:36:45.728644 11608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:45.727682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:49951)
0808 23:36:45.728294 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:45.728399 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":338,"threads_started":1}
I20260808 23:36:45.733050 11609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:45.732034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:33755)
0808 23:36:45.732565 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:45.732708 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":230,"threads_started":1}
I20260808 23:36:46.250067 11610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:46.249290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:34593)
0808 23:36:46.249778 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:46.249873 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":235,"threads_started":1}
I20260808 23:36:46.730566 11611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:46.729745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:36153)
0808 23:36:46.730279 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:46.730388 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":277,"threads_started":1}
I20260808 23:36:46.735088 11612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:46.734180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:51349)
0808 23:36:46.734791 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:46.734886 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":315,"threads_started":1}
I20260808 23:36:47.251847 11613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:47.251065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:57109)
0808 23:36:47.251555 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:47.251648 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":250,"threads_started":1}
I20260808 23:36:47.732565 11614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:47.731620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:52535)
0808 23:36:47.732200 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:47.732339 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":321,"threads_started":1}
I20260808 23:36:47.737106 11615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:47.736138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:41391)
0808 23:36:47.736826 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:47.736921 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":439,"threads_started":1}
I20260808 23:36:48.254101 11616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:48.253243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:39267)
0808 23:36:48.253820 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:48.253918 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":321,"threads_started":1}
I20260808 23:36:48.734396 11618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:48.733634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:51997)
0808 23:36:48.734143 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:48.734235 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":265,"threads_started":1}
I20260808 23:36:48.738866 11619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:48.738068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:52193)
0808 23:36:48.738570 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:48.738659 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":251,"threads_started":1}
I20260808 23:36:49.255843 11620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:49.255052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:59267)
0808 23:36:49.255579 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:49.255663 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":274,"threads_started":1}
I20260808 23:36:49.736228 11624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:49.735440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:48265)
0808 23:36:49.735939 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:49.736030 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":271,"threads_started":1}
I20260808 23:36:49.740670 11625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:49.739897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:50669)
0808 23:36:49.740387 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:49.740478 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":251,"threads_started":1}
I20260808 23:36:50.257879 11626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:50.257020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:43027)
0808 23:36:50.257576 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:50.257695 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":260,"threads_started":1}
I20260808 23:36:50.738318 11627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:50.737388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:49229)
0808 23:36:50.737991 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:50.738091 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":284,"threads_started":1}
I20260808 23:36:50.742431 11628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:50.741615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:45275)
0808 23:36:50.742156 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:50.742256 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":302,"threads_started":1}
I20260808 23:36:51.259945 11629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:51.259004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:59249)
0808 23:36:51.259613 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:51.259712 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":255,"threads_started":1}
I20260808 23:36:51.740165 11630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:51.739381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:42911)
0808 23:36:51.739865 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:51.739969 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":258,"threads_started":1}
I20260808 23:36:51.744426 11631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:51.743482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:55853)
0808 23:36:51.744062 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:51.744161 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":250,"threads_started":1}
I20260808 23:36:52.262066 11632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:52.261223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:35289)
0808 23:36:52.261810 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:52.261893 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":336,"threads_started":1}
I20260808 23:36:52.742349 11633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:52.741311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:47369)
0808 23:36:52.741967 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:52.742127 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":352,"threads_started":1}
I20260808 23:36:52.746462 11635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:52.745554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:55127)
0808 23:36:52.746181 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:52.746273 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":375,"threads_started":1}
I20260808 23:36:53.264110 11636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:53.263127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:59225)
0808 23:36:53.263812 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:53.263915 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":414,"threads_started":1}
I20260808 23:36:53.744350 11637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:53.743464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:39125)
0808 23:36:53.744044 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:53.744148 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":309,"threads_started":1}
I20260808 23:36:53.748440 11638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:53.747544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:50655)
0808 23:36:53.748163 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:53.748249 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":330,"threads_started":1}
I20260808 23:36:54.266243 11639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:54.265449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:60979)
0808 23:36:54.265960 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:54.266071 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":258,"threads_started":1}
I20260808 23:36:54.746361 11641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:54.745430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:59937)
0808 23:36:54.745969 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:54.746072 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":303,"threads_started":1}
I20260808 23:36:54.750289 11642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:54.749524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:38035)
0808 23:36:54.750021 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:54.750116 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":272,"threads_started":1}
I20260808 23:36:55.268168 11643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:55.267342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:41661)
0808 23:36:55.267865 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:55.267976 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":260,"threads_started":1}
I20260808 23:36:55.748442 11644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:55.747578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:43295)
0808 23:36:55.748119 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:55.748217 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":277,"threads_started":1}
I20260808 23:36:55.752204 11645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:55.751273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:41529)
0808 23:36:55.751802 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:55.751943 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":245,"threads_started":1}
I20260808 23:36:56.270345 11647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:56.269450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:39555)
0808 23:36:56.270057 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:56.270165 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":340,"threads_started":1}
I20260808 23:36:56.750455 11648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:56.749600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:50793)
0808 23:36:56.750120 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:56.750243 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":247,"threads_started":1}
I20260808 23:36:56.753906 11649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:56.753139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:58423)
0808 23:36:56.753656 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:56.753745 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":286,"threads_started":1}
I20260808 23:36:57.272246 11650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:57.271447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:33577)
0808 23:36:57.271934 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:57.272040 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":233,"threads_started":1}
I20260808 23:36:57.752470 11651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:57.751553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:48517)
0808 23:36:57.752113 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:57.752235 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":303,"threads_started":1}
I20260808 23:36:57.755728 11652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:57.754913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:44049)
0808 23:36:57.755438 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:57.755532 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":272,"threads_started":1}
I20260808 23:36:58.274240 11653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:58.273420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:45611)
0808 23:36:58.273927 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:58.274025 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":250,"threads_started":1}
I20260808 23:36:58.754637 11654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:58.753799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:33939)
0808 23:36:58.754326 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:58.754438 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":274,"threads_started":1}
I20260808 23:36:58.757620 11655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:58.756718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:37763)
0808 23:36:58.757306 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:58.757420 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":386,"threads_started":1}
I20260808 23:36:59.276710 11656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:59.275682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.194:55957)
0808 23:36:59.276300 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:59.276443 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":326,"threads_started":1}
I20260808 23:36:59.733794 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 11142
I20260808 23:36:59.757267 11658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:59.755718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.193:52575)
0808 23:36:59.756597 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:59.756862 (+ 265us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":737,"thread_start_us":569,"threads_started":1}
I20260808 23:36:59.759629 11659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:59.758737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:41149 (local address 127.26.207.195:57657)
0808 23:36:59.759270 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0808 23:36:59.759396 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:41149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":265,"threads_started":1}
I20260808 23:36:59.760186 11657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:59.735049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42548 (local address 127.26.207.193:37483)
0808 23:36:59.735768 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:59.735784 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:59.735828 (+ 44us) server_negotiation.cc:407] Connection header received
0808 23:36:59.737734 (+ 1906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:59.737745 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:59.738212 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:59.738598 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:59.740264 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:59.741696 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:59.743133 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:59.743901 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:59.744145 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:59.752636 (+ 8491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:59.752646 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:59.752666 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:59.752717 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:59.755988 (+ 3271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:59.757094 (+ 1106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:59.757102 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:59.757114 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:59.757353 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:59.757825 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:59.757828 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:59.757831 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:59.758452 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:59.758692 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:59.759375 (+ 683us) server_negotiation.cc:299] Negotiation successful
0808 23:36:59.759885 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":326,"threads_started":1}
I20260808 23:36:59.761734 11310 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:59.852137 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 11142
I20260808 23:36:59.876940 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 11319
I20260808 23:36:59.896903 11662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:36:59.877924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40832 (local address 127.26.207.194:34147)
0808 23:36:59.878526 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0808 23:36:59.878541 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 23:36:59.878582 (+ 41us) server_negotiation.cc:407] Connection header received
0808 23:36:59.880244 (+ 1662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:36:59.880254 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:36:59.880721 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:36:59.881136 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:36:59.882630 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:59.883940 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:59.885549 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:36:59.886336 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:36:59.886518 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:36:59.889687 (+ 3169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:36:59.889697 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:36:59.889716 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:36:59.889776 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:36:59.893068 (+ 3292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:59.893993 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:59.894002 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:59.894011 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:59.894240 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:36:59.894667 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:36:59.894670 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:36:59.894672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:36:59.895299 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:36:59.895587 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0808 23:36:59.896002 (+ 415us) server_negotiation.cc:299] Negotiation successful
0808 23:36:59.896517 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":280,"threads_started":1}
I20260808 23:36:59.898589 11454 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:36:59.986498 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 11319
I20260808 23:37:00.009902 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 11463
I20260808 23:37:00.030411 11664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:00.011069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38078 (local address 127.26.207.195:38889)
0808 23:37:00.011702 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:00.011717 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:00.011763 (+ 46us) server_negotiation.cc:407] Connection header received
0808 23:37:00.013677 (+ 1914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:00.013688 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:00.014172 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:00.014483 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:00.016331 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:00.017827 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:00.019379 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:00.020141 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:00.020296 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:00.023380 (+ 3084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:00.023392 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:00.023418 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:00.023475 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:00.026792 (+ 3317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:00.027590 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:00.027599 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:00.027606 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:00.027807 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:00.028207 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:00.028210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:00.028212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:00.028886 (+ 674us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:00.029197 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:00.029557 (+ 360us) server_negotiation.cc:299] Negotiation successful
0808 23:37:00.030084 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":289,"threads_started":1}
I20260808 23:37:00.032419 11596 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:37:00.122927 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 11463
2026-08-08T23:37:00Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25539 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:37:00 dist-test-slave-1x4g krb5kdc[11668](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:37:00 dist-test-slave-1x4g krb5kdc[11668](info): set up 2 sockets
Aug 08 23:37:00 dist-test-slave-1x4g krb5kdc[11668](info): commencing operation
krb5kdc: starting...
W20260808 23:37:01.326812 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.010s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:37:01 dist-test-slave-1x4g krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:37:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:37:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:37:01.665657 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:34615
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:43625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:34615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:37:02.046473 11682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:37:02.046794 11682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:37:02.046890 11682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:37:02.054589 11682 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 23:37:02.054718 11682 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 23:37:02.054759 11682 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 23:37:02.054803 11682 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:37:02.054862 11682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:37:02.054940 11682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:37:02.054988 11682 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:37:02.055037 11682 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:37:02.065692 11682 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:34615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:34615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:37:02.067106 11682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:37:02.068490 11682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:37:02.082567 11687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:02.082661 11690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:02.082592 11688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:37:02.084069 11682 server_base.cc:1034] running on GCE node
I20260808 23:37:02.085147 11682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:37:02.086798 11682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:37:02.088068 11682 hybrid_clock.cc:648] HybridClock initialized: now 1786232222087996 us; error 38 us; skew 500 ppm
I20260808 23:37:02.088493 11682 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:37:02 dist-test-slave-1x4g krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232222, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:37:02.092134 11682 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:37:02.094002 11682 webserver.cc:460] Webserver started at http://127.26.207.254:39911/ using document root <none> and password file <none>
I20260808 23:37:02.095077 11682 fs_manager.cc:359] Metadata directory not provided
I20260808 23:37:02.095249 11682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:37:02.095649 11682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:37:02.100392 11682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "6a51dd41cca54939bb7a54f94219841e"
format_stamp: "Formatted at 2026-08-08 23:37:02 on dist-test-slave-1x4g"
server_key: "fbf2284637a65cda0c82429a85cfe9a5"
server_key_iv: "c8aad6ba3e4fcaabb8867d8c449e1d46"
server_key_version: "encryptionkey@0"
I20260808 23:37:02.101630 11682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "6a51dd41cca54939bb7a54f94219841e"
format_stamp: "Formatted at 2026-08-08 23:37:02 on dist-test-slave-1x4g"
server_key: "fbf2284637a65cda0c82429a85cfe9a5"
server_key_iv: "c8aad6ba3e4fcaabb8867d8c449e1d46"
server_key_version: "encryptionkey@0"
I20260808 23:37:02.108399 11682 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 23:37:02.113013 11697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:02.114934 11682 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:37:02.115208 11682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "6a51dd41cca54939bb7a54f94219841e"
format_stamp: "Formatted at 2026-08-08 23:37:02 on dist-test-slave-1x4g"
server_key: "fbf2284637a65cda0c82429a85cfe9a5"
server_key_iv: "c8aad6ba3e4fcaabb8867d8c449e1d46"
server_key_version: "encryptionkey@0"
I20260808 23:37:02.115507 11682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:37:02.140705 11682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:37:02.145805 11682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:37:02.146139 11682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:37:02.166762 11682 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:34615
I20260808 23:37:02.166769 11754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:34615 every 8 connection(s)
I20260808 23:37:02.168365 11682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:37:02.171614 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 11682
I20260808 23:37:02.171872 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:37:02.172760 27455 external_mini_cluster.cc:1428] Setting key d1d8026c1d8c76f026a868b0afe5c38f
I20260808 23:37:02.173460 11755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:37:02.187590 11755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Bootstrap starting.
Aug 08 23:37:02 dist-test-slave-1x4g krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:37:02.191826 11755 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Neither blocks nor log segments found. Creating new log.
I20260808 23:37:02.193181 11755 log.cc:824] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Log is configured to *not* fsync() on all Append() calls
I20260808 23:37:02.197734 11755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: No bootstrap required, opened a new log
I20260808 23:37:02.200570 11758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:02.175233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41196 (local address 127.26.207.254:34615)
0808 23:37:02.176195 (+ 962us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:02.176209 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:02.176256 (+ 47us) server_negotiation.cc:407] Connection header received
0808 23:37:02.178786 (+ 2530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:02.178817 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:02.179381 (+ 564us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:02.179891 (+ 510us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:02.181805 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:02.183177 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:02.184751 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:02.185647 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:02.185889 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:02.191063 (+ 5174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:02.191074 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:02.191092 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:02.191144 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:02.195320 (+ 4176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:02.196636 (+ 1316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:02.196643 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:02.196652 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:02.196933 (+ 281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:02.197470 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:02.197474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:02.197476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:02.198137 (+ 661us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:02.198408 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:02.198969 (+ 561us) server_negotiation.cc:299] Negotiation successful
0808 23:37:02.199356 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":705,"thread_start_us":434,"threads_started":1}
I20260808 23:37:02.207396 11755 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } }
I20260808 23:37:02.207919 11755 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:37:02.208098 11755 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a51dd41cca54939bb7a54f94219841e, State: Initialized, Role: FOLLOWER
I20260808 23:37:02.208766 11755 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } }
I20260808 23:37:02.209148 11755 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:37:02.209343 11755 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:37:02.209571 11755 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:37:02.212255 11755 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } }
I20260808 23:37:02.213028 11755 leader_election.cc:302] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a51dd41cca54939bb7a54f94219841e; no voters:
I20260808 23:37:02.213932 11755 leader_election.cc:288] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:37:02.214083 11760 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:37:02.215018 11760 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 1 LEADER]: Becoming Leader. State: Replica: 6a51dd41cca54939bb7a54f94219841e, State: Running, Role: LEADER
I20260808 23:37:02.215776 11760 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } }
I20260808 23:37:02.217028 11755 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:37:02.219202 11762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a51dd41cca54939bb7a54f94219841e. Latest consensus state: current_term: 1 leader_uuid: "6a51dd41cca54939bb7a54f94219841e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } } }
I20260808 23:37:02.220268 11762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [sys.catalog]: This master's current role is: LEADER
I20260808 23:37:02.219934 11761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a51dd41cca54939bb7a54f94219841e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } } }
I20260808 23:37:02.220804 11761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [sys.catalog]: This master's current role is: LEADER
I20260808 23:37:02.226402 11769 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:37:02.233549 11769 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:37:02.244910 11769 catalog_manager.cc:1347] Generated new cluster ID: 3dff933a1e9a4f829038a0e55b5fbf5d
I20260808 23:37:02.245102 11769 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:37:02.254549 11769 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:37:02.256016 11769 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:37:02.263958 11769 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Generated new TSK 0
I20260808 23:37:02.265066 11769 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:37:02.366967 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:34615
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:43625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:37:02.739995 11785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:37:02.740310 11785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:37:02.740494 11785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:37:02.748306 11785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:37:02.748456 11785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:37:02.748653 11785 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:37:02.759079 11785 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:34615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:37:02.760553 11785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:37:02.761991 11785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:37:02.776741 11791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:02.776851 11790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:02.776659 11795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:37:02.778083 11785 server_base.cc:1034] running on GCE node
I20260808 23:37:02.778800 11785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:37:02.779996 11785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:37:02.781242 11785 hybrid_clock.cc:648] HybridClock initialized: now 1786232222781198 us; error 46 us; skew 500 ppm
I20260808 23:37:02.781613 11785 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:37:02 dist-test-slave-1x4g krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232222, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:37:02.785166 11785 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:37:02.786775 11785 webserver.cc:460] Webserver started at http://127.26.207.193:37385/ using document root <none> and password file <none>
I20260808 23:37:02.787492 11785 fs_manager.cc:359] Metadata directory not provided
I20260808 23:37:02.787602 11785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:37:02.787887 11785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:37:02.791260 11785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "98579751614e4390af7c16894897d4ec"
format_stamp: "Formatted at 2026-08-08 23:37:02 on dist-test-slave-1x4g"
server_key: "42c1a30fccdec56c614dffa011241f44"
server_key_iv: "c34bc9b486bad7656da629f534b31ef1"
server_key_version: "encryptionkey@0"
I20260808 23:37:02.792143 11785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "98579751614e4390af7c16894897d4ec"
format_stamp: "Formatted at 2026-08-08 23:37:02 on dist-test-slave-1x4g"
server_key: "42c1a30fccdec56c614dffa011241f44"
server_key_iv: "c34bc9b486bad7656da629f534b31ef1"
server_key_version: "encryptionkey@0"
I20260808 23:37:02.798228 11785 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260808 23:37:02.802459 11802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:02.804133 11785 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:37:02.804311 11785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "98579751614e4390af7c16894897d4ec"
format_stamp: "Formatted at 2026-08-08 23:37:02 on dist-test-slave-1x4g"
server_key: "42c1a30fccdec56c614dffa011241f44"
server_key_iv: "c34bc9b486bad7656da629f534b31ef1"
server_key_version: "encryptionkey@0"
I20260808 23:37:02.804529 11785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:37:02.826642 11785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:37:02.833653 11785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:37:02.834035 11785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:37:02.835438 11785 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:37:02.837222 11785 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:37:02.837316 11785 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:02.837464 11785 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:37:02.837532 11785 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:02.874037 11785 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:43593
I20260808 23:37:02.874086 11926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:43593 every 8 connection(s)
I20260808 23:37:02.875586 11785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:37:02.881686 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 11785
I20260808 23:37:02.881950 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:37:02.882654 27455 external_mini_cluster.cc:1428] Setting key 68eb8925e6f4ef464b67d58a3b0e356e
Aug 08 23:37:02 dist-test-slave-1x4g krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232222, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:37:02.898187 11929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:02.878778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:44131 (local address 127.26.207.254:34615)
0808 23:37:02.879289 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:02.879293 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:02.880351 (+ 1058us) server_negotiation.cc:407] Connection header received
0808 23:37:02.882556 (+ 2205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:02.882562 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:02.882668 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:02.882797 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:02.884562 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:02.885394 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:02.887146 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:02.887559 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:02.887717 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:02.891854 (+ 4137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:02.891860 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:02.891863 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:02.891903 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:02.894648 (+ 2745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:02.895547 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:02.895559 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:02.895562 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:02.895710 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:02.896189 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:02.896194 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:02.896199 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:02.896489 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:02.896670 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:02.897519 (+ 849us) server_negotiation.cc:299] Negotiation successful
0808 23:37:02.897782 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":261,"threads_started":1}
I20260808 23:37:02.899268 11930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:02.879390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:44131)
0808 23:37:02.880172 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:02.880214 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 23:37:02.882243 (+ 2029us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:37:02.883138 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:37:02.883151 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:37:02.883728 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:37:02.884359 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:02.884379 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:02.885605 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:02.885609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:02.886945 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:02.886960 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:02.887837 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:02.887845 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:02.888119 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:02.888943 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:37:02.888973 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:37:02.891562 (+ 2589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:37:02.894835 (+ 3273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:37:02.894845 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:37:02.894868 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:37:02.895394 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:37:02.895841 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:37:02.895846 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:37:02.895850 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:37:02.896065 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:37:02.896645 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:37:02.896654 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:37:02.897110 (+ 456us) client_negotiation.cc:769] Sending connection context
0808 23:37:02.897411 (+ 301us) client_negotiation.cc:240] Negotiation successful
0808 23:37:02.898038 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":293,"threads_started":1}
I20260808 23:37:02.901196 11927 heartbeater.cc:347] Connected to a master server at 127.26.207.254:34615
I20260808 23:37:02.901588 11927 heartbeater.cc:464] Registering TS with master...
I20260808 23:37:02.902406 11927 heartbeater.cc:511] Master 127.26.207.254:34615 requested a full tablet report, sending...
I20260808 23:37:02.905258 11716 ts_manager.cc:194] Registered new tserver with Master: 98579751614e4390af7c16894897d4ec (127.26.207.193:43593)
I20260808 23:37:02.907904 11716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:44131
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:37:02.966110 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:34615
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:43625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:37:03.350358 11933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:37:03.350798 11933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:37:03.351022 11933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:37:03.359695 11933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:37:03.359922 11933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:37:03.360150 11933 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:37:03.370895 11933 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:34615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:37:03.372633 11933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:37:03.374578 11933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:37:03.390453 11942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:03.390507 11940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:03.390477 11939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:37:03.391494 11933 server_base.cc:1034] running on GCE node
I20260808 23:37:03.392228 11933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:37:03.393409 11933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:37:03.394649 11933 hybrid_clock.cc:648] HybridClock initialized: now 1786232223394573 us; error 65 us; skew 500 ppm
I20260808 23:37:03.395044 11933 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:37:03 dist-test-slave-1x4g krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232223, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:37:03.398959 11933 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:37:03.400895 11933 webserver.cc:460] Webserver started at http://127.26.207.194:42229/ using document root <none> and password file <none>
I20260808 23:37:03.401806 11933 fs_manager.cc:359] Metadata directory not provided
I20260808 23:37:03.401928 11933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:37:03.402218 11933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:37:03.405601 11933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "3b001d67e3754ffab5134e5ecd42d24a"
format_stamp: "Formatted at 2026-08-08 23:37:03 on dist-test-slave-1x4g"
server_key: "b2dcd32a53ffd83d191c3d6742ebc6b8"
server_key_iv: "5310dba5870328dbca0640b8924b5ec5"
server_key_version: "encryptionkey@0"
I20260808 23:37:03.406445 11933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "3b001d67e3754ffab5134e5ecd42d24a"
format_stamp: "Formatted at 2026-08-08 23:37:03 on dist-test-slave-1x4g"
server_key: "b2dcd32a53ffd83d191c3d6742ebc6b8"
server_key_iv: "5310dba5870328dbca0640b8924b5ec5"
server_key_version: "encryptionkey@0"
I20260808 23:37:03.413070 11933 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 23:37:03.417265 11950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:03.418972 11933 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 23:37:03.419234 11933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "3b001d67e3754ffab5134e5ecd42d24a"
format_stamp: "Formatted at 2026-08-08 23:37:03 on dist-test-slave-1x4g"
server_key: "b2dcd32a53ffd83d191c3d6742ebc6b8"
server_key_iv: "5310dba5870328dbca0640b8924b5ec5"
server_key_version: "encryptionkey@0"
I20260808 23:37:03.419451 11933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:37:03.452699 11933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:37:03.457466 11933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:37:03.457796 11933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:37:03.458897 11933 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:37:03.460367 11933 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:37:03.460451 11933 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:03.460578 11933 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:37:03.460649 11933 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:03.497109 11933 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:43563
I20260808 23:37:03.497146 12073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:43563 every 8 connection(s)
I20260808 23:37:03.498762 11933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:37:03.502049 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 11933
I20260808 23:37:03.502259 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:37:03.502876 27455 external_mini_cluster.cc:1428] Setting key 98f6f90079d5f2173336174d68c1ec92
Aug 08 23:37:03 dist-test-slave-1x4g krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232223, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:37:03.522292 12076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:03.501585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:50969 (local address 127.26.207.254:34615)
0808 23:37:03.502159 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:03.502167 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:03.503311 (+ 1144us) server_negotiation.cc:407] Connection header received
0808 23:37:03.506129 (+ 2818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:03.506134 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:03.506243 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:03.506370 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:03.508084 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:03.509029 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:03.510748 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:03.511193 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:03.511343 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:03.515500 (+ 4157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:03.515506 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:03.515509 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:03.515547 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:03.518592 (+ 3045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:03.519521 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:03.519528 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:03.519537 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:03.519684 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:03.520229 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:03.520235 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:03.520240 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:03.520623 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:03.520819 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:03.521626 (+ 807us) server_negotiation.cc:299] Negotiation successful
0808 23:37:03.521896 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":323,"threads_started":1}
I20260808 23:37:03.523417 12077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:03.502272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:50969)
0808 23:37:03.503136 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:03.503185 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 23:37:03.505756 (+ 2571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:37:03.506657 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:37:03.506667 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:37:03.507250 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:37:03.507875 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:03.507896 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:03.509219 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:03.509223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:03.510577 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:03.510592 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:03.511458 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:03.511466 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:03.511721 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:03.512493 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:37:03.512518 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:37:03.515200 (+ 2682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:37:03.518778 (+ 3578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:37:03.518789 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:37:03.518816 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:37:03.519366 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:37:03.519818 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:37:03.519823 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:37:03.519827 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:37:03.520103 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:37:03.520767 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:37:03.520794 (+ 27us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:37:03.521213 (+ 419us) client_negotiation.cc:769] Sending connection context
0808 23:37:03.521529 (+ 316us) client_negotiation.cc:240] Negotiation successful
0808 23:37:03.522154 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":328,"threads_started":1}
I20260808 23:37:03.525238 12074 heartbeater.cc:347] Connected to a master server at 127.26.207.254:34615
I20260808 23:37:03.525637 12074 heartbeater.cc:464] Registering TS with master...
I20260808 23:37:03.526770 12074 heartbeater.cc:511] Master 127.26.207.254:34615 requested a full tablet report, sending...
I20260808 23:37:03.528726 11716 ts_manager.cc:194] Registered new tserver with Master: 3b001d67e3754ffab5134e5ecd42d24a (127.26.207.194:43563)
I20260808 23:37:03.530146 11716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:50969
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:37:03.580989 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:34615
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:43625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:37:03.912721 11927 heartbeater.cc:503] Master 127.26.207.254:34615 was elected leader, sending a full tablet report...
W20260808 23:37:03.984634 12080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:37:03.985049 12080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:37:03.985248 12080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:37:03.993045 12080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:37:03.993218 12080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:37:03.993395 12080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:37:04.003861 12080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:34615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:37:04.005448 12080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:37:04.006976 12080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:37:04.022858 12086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:04.023311 12085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:04.024564 12088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:37:04.025007 12080 server_base.cc:1034] running on GCE node
I20260808 23:37:04.025964 12080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:37:04.027473 12080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:37:04.028764 12080 hybrid_clock.cc:648] HybridClock initialized: now 1786232224028667 us; error 87 us; skew 500 ppm
I20260808 23:37:04.029312 12080 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:37:04 dist-test-slave-1x4g krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232224, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:37:04.034502 12080 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:37:04.036666 12080 webserver.cc:460] Webserver started at http://127.26.207.195:41097/ using document root <none> and password file <none>
I20260808 23:37:04.037879 12080 fs_manager.cc:359] Metadata directory not provided
I20260808 23:37:04.038101 12080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:37:04.038549 12080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:37:04.043859 12080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "b1045037db4d4614b4c73e07d0d2a912"
format_stamp: "Formatted at 2026-08-08 23:37:04 on dist-test-slave-1x4g"
server_key: "ae3d1b52d94baabbfbd7a052cf873d9c"
server_key_iv: "4be0e4e1dfe6e852ccc1178d4543b424"
server_key_version: "encryptionkey@0"
I20260808 23:37:04.045228 12080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "b1045037db4d4614b4c73e07d0d2a912"
format_stamp: "Formatted at 2026-08-08 23:37:04 on dist-test-slave-1x4g"
server_key: "ae3d1b52d94baabbfbd7a052cf873d9c"
server_key_iv: "4be0e4e1dfe6e852ccc1178d4543b424"
server_key_version: "encryptionkey@0"
I20260808 23:37:04.054342 12080 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.000s
I20260808 23:37:04.060678 12095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:04.062845 12080 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 23:37:04.063086 12080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "b1045037db4d4614b4c73e07d0d2a912"
format_stamp: "Formatted at 2026-08-08 23:37:04 on dist-test-slave-1x4g"
server_key: "ae3d1b52d94baabbfbd7a052cf873d9c"
server_key_iv: "4be0e4e1dfe6e852ccc1178d4543b424"
server_key_version: "encryptionkey@0"
I20260808 23:37:04.063393 12080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:37:04.102330 12080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:37:04.107366 12080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:37:04.107699 12080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:37:04.108968 12080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:37:04.110659 12080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:37:04.110769 12080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:04.110924 12080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:37:04.111006 12080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:04.150709 12080 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:40069
I20260808 23:37:04.150750 12218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:40069 every 8 connection(s)
I20260808 23:37:04.152107 12080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:37:04.158707 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 12080
I20260808 23:37:04.158944 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:37:04.159617 27455 external_mini_cluster.cc:1428] Setting key 84173178f3618091d1fd8a78e5ad17b6
Aug 08 23:37:04 dist-test-slave-1x4g krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232224, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:37:04.179977 12222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.155171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:48401 (local address 127.26.207.254:34615)
0808 23:37:04.155674 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:04.155679 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:04.157189 (+ 1510us) server_negotiation.cc:407] Connection header received
0808 23:37:04.159331 (+ 2142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:04.159336 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:04.159447 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:04.159573 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:04.161707 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.162876 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.166134 (+ 3258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.166667 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.166785 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.172129 (+ 5344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:04.172135 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:04.172138 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:04.172180 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:04.176131 (+ 3951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:04.177256 (+ 1125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:04.177261 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:04.177263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:04.177405 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:04.177930 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:04.177934 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:04.177936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:04.178245 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:04.178417 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:04.179272 (+ 855us) server_negotiation.cc:299] Negotiation successful
0808 23:37:04.179553 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":279,"threads_started":1}
I20260808 23:37:04.181159 12223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.155910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:48401)
0808 23:37:04.157005 (+ 1095us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:04.157052 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 23:37:04.159003 (+ 1951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:37:04.159862 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:37:04.159871 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:37:04.160582 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:37:04.161527 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:04.161550 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.163089 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.163098 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:04.165884 (+ 2786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:04.165925 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.167000 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.167010 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:04.167451 (+ 441us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.168393 (+ 942us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:37:04.168435 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:37:04.171791 (+ 3356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:37:04.176310 (+ 4519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:37:04.176320 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:37:04.176347 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:37:04.177091 (+ 744us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:37:04.177547 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:37:04.177552 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:37:04.177556 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:37:04.177781 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:37:04.178400 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:37:04.178409 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:37:04.178809 (+ 400us) client_negotiation.cc:769] Sending connection context
0808 23:37:04.179123 (+ 314us) client_negotiation.cc:240] Negotiation successful
0808 23:37:04.179742 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"thread_start_us":451,"threads_started":1}
I20260808 23:37:04.182775 12219 heartbeater.cc:347] Connected to a master server at 127.26.207.254:34615
I20260808 23:37:04.183168 12219 heartbeater.cc:464] Registering TS with master...
I20260808 23:37:04.183998 12219 heartbeater.cc:511] Master 127.26.207.254:34615 requested a full tablet report, sending...
I20260808 23:37:04.185905 11716 ts_manager.cc:194] Registered new tserver with Master: b1045037db4d4614b4c73e07d0d2a912 (127.26.207.195:40069)
I20260808 23:37:04.186864 11716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:48401
I20260808 23:37:04.189481 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:37:04.209043 12222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.194473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41198 (local address 127.26.207.254:34615)
0808 23:37:04.194678 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:04.194683 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:04.195234 (+ 551us) server_negotiation.cc:407] Connection header received
0808 23:37:04.195419 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:04.195424 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:04.195515 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:04.195627 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:04.197372 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.198143 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.199646 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.200081 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.200196 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.203151 (+ 2955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:04.203157 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:04.203160 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:04.203201 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:04.206053 (+ 2852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:04.206945 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:04.206949 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:04.206952 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:04.207111 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:04.207498 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:04.207501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:04.207503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:04.207852 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:04.208054 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:04.208411 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 23:37:04.208719 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 23:37:04.213760 11716 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41198:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:37:04.221815 11716 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:37:04.259730 12236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.236021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36374 (local address 127.26.207.194:43563)
0808 23:37:04.248173 (+ 12152us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:04.248189 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:04.249701 (+ 1512us) server_negotiation.cc:407] Connection header received
0808 23:37:04.249905 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:04.249911 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:04.250122 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:04.250320 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:37:04.251401 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.252963 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.256378 (+ 3415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.257908 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.258096 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.258290 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:04.259167 (+ 877us) server_negotiation.cc:299] Negotiation successful
0808 23:37:04.259367 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11863,"thread_start_us":11712,"threads_started":1}
I20260808 23:37:04.259943 12233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.235467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:43593 (local address 127.0.0.1:45854)
0808 23:37:04.248881 (+ 13414us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:04.248945 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 23:37:04.249222 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:37:04.250214 (+ 992us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:37:04.250227 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:37:04.250265 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:37:04.250801 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:04.250819 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.253103 (+ 2284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.253109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:04.256023 (+ 2914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:04.256042 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.258518 (+ 2476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.258532 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:04.258793 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.258922 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 23:37:04.259098 (+ 176us) client_negotiation.cc:240] Negotiation successful
0808 23:37:04.259357 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13064,"mutex_wait_us":32,"thread_start_us":12828,"threads_started":1}
I20260808 23:37:04.260218 12234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.235815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:43563 (local address 127.0.0.1:36374)
0808 23:37:04.249551 (+ 13736us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:04.249572 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 23:37:04.249730 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:37:04.250633 (+ 903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:37:04.250637 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:37:04.250664 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:37:04.251193 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:04.251210 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.253117 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.253121 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:04.256201 (+ 3080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:04.256221 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.258464 (+ 2243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.258474 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:04.258797 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.258924 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 23:37:04.259089 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 23:37:04.259362 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13601,"mutex_wait_us":102,"thread_start_us":13428,"threads_started":1}
I20260808 23:37:04.260988 12235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.235785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45854 (local address 127.26.207.193:43593)
0808 23:37:04.248768 (+ 12983us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:04.249003 (+ 235us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:04.249047 (+ 44us) server_negotiation.cc:407] Connection header received
0808 23:37:04.249614 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:04.249625 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:04.249927 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:04.250168 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:37:04.251089 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.252896 (+ 1807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.256241 (+ 3345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.257879 (+ 1638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.258103 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.258316 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:04.260403 (+ 2087us) server_negotiation.cc:299] Negotiation successful
0808 23:37:04.260626 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12782,"thread_start_us":12992,"threads_started":1}
I20260808 23:37:04.263540 12238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.250698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:40069 (local address 127.0.0.1:47530)
0808 23:37:04.254409 (+ 3711us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:04.254439 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 23:37:04.254589 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:37:04.255388 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:37:04.255392 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:37:04.255420 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:37:04.255907 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:04.255919 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.258075 (+ 2156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.258081 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:04.260508 (+ 2427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:04.260523 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.262672 (+ 2149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.262680 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:04.262878 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.262913 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 23:37:04.263024 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 23:37:04.263185 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3549,"thread_start_us":3170,"threads_started":1}
I20260808 23:37:04.263691 12237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.250008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47530 (local address 127.26.207.195:40069)
0808 23:37:04.253729 (+ 3721us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:04.253738 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:04.254749 (+ 1011us) server_negotiation.cc:407] Connection header received
0808 23:37:04.254872 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:04.254883 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:04.255187 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:04.255412 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:37:04.256124 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.257872 (+ 1748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.260685 (+ 2813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.262108 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.262322 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.262508 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:04.263115 (+ 607us) server_negotiation.cc:299] Negotiation successful
0808 23:37:04.263317 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3525,"thread_start_us":3323,"threads_started":1}
I20260808 23:37:04.264860 12003 tablet_service.cc:1467] Processing CreateTablet for tablet 981dd8ee5efe4b7c946c8fc7e65add10 (DEFAULT_TABLE table=test-table [id=6c8cbc58542c4ebba9d7fcb05c48cb1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:37:04.265254 11856 tablet_service.cc:1467] Processing CreateTablet for tablet 981dd8ee5efe4b7c946c8fc7e65add10 (DEFAULT_TABLE table=test-table [id=6c8cbc58542c4ebba9d7fcb05c48cb1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:37:04.266335 12003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 981dd8ee5efe4b7c946c8fc7e65add10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:37:04.266613 11856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 981dd8ee5efe4b7c946c8fc7e65add10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:37:04.270133 12148 tablet_service.cc:1467] Processing CreateTablet for tablet 981dd8ee5efe4b7c946c8fc7e65add10 (DEFAULT_TABLE table=test-table [id=6c8cbc58542c4ebba9d7fcb05c48cb1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:37:04.271840 12148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 981dd8ee5efe4b7c946c8fc7e65add10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:37:04.280542 12239 tablet_bootstrap.cc:492] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a: Bootstrap starting.
I20260808 23:37:04.284344 12240 tablet_bootstrap.cc:492] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec: Bootstrap starting.
I20260808 23:37:04.284698 12239 tablet_bootstrap.cc:654] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a: Neither blocks nor log segments found. Creating new log.
I20260808 23:37:04.287406 12239 log.cc:824] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a: Log is configured to *not* fsync() on all Append() calls
I20260808 23:37:04.288674 12241 tablet_bootstrap.cc:492] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912: Bootstrap starting.
I20260808 23:37:04.288702 12240 tablet_bootstrap.cc:654] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec: Neither blocks nor log segments found. Creating new log.
I20260808 23:37:04.290530 12240 log.cc:824] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec: Log is configured to *not* fsync() on all Append() calls
I20260808 23:37:04.292266 12241 tablet_bootstrap.cc:654] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912: Neither blocks nor log segments found. Creating new log.
I20260808 23:37:04.293489 12241 log.cc:824] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912: Log is configured to *not* fsync() on all Append() calls
I20260808 23:37:04.297150 12241 tablet_bootstrap.cc:492] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912: No bootstrap required, opened a new log
I20260808 23:37:04.297256 12239 tablet_bootstrap.cc:492] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a: No bootstrap required, opened a new log
I20260808 23:37:04.297485 12241 ts_tablet_manager.cc:1397] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 23:37:04.297569 12239 ts_tablet_manager.cc:1397] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.007s
I20260808 23:37:04.297729 12240 tablet_bootstrap.cc:492] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec: No bootstrap required, opened a new log
I20260808 23:37:04.298009 12240 ts_tablet_manager.cc:1397] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260808 23:37:04.305220 12241 raft_consensus.cc:348] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } } peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } }
I20260808 23:37:04.305709 12241 raft_consensus.cc:374] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:37:04.305814 12241 raft_consensus.cc:729] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1045037db4d4614b4c73e07d0d2a912, State: Initialized, Role: FOLLOWER
I20260808 23:37:04.306782 12241 consensus_queue.cc:260] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } } peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } }
I20260808 23:37:04.308177 12219 heartbeater.cc:503] Master 127.26.207.254:34615 was elected leader, sending a full tablet report...
I20260808 23:37:04.309150 12241 ts_tablet_manager.cc:1428] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260808 23:37:04.309237 12239 raft_consensus.cc:348] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } } peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } }
I20260808 23:37:04.309939 12239 raft_consensus.cc:374] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:37:04.310077 12239 raft_consensus.cc:729] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b001d67e3754ffab5134e5ecd42d24a, State: Initialized, Role: FOLLOWER
I20260808 23:37:04.310807 12239 consensus_queue.cc:260] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } } peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } }
I20260808 23:37:04.310695 12240 raft_consensus.cc:348] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } } peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } }
I20260808 23:37:04.311183 12240 raft_consensus.cc:374] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:37:04.311300 12240 raft_consensus.cc:729] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98579751614e4390af7c16894897d4ec, State: Initialized, Role: FOLLOWER
I20260808 23:37:04.312213 12074 heartbeater.cc:503] Master 127.26.207.254:34615 was elected leader, sending a full tablet report...
I20260808 23:37:04.312106 12240 consensus_queue.cc:260] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } } peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } }
I20260808 23:37:04.313216 12239 ts_tablet_manager.cc:1428] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a: Time spent starting tablet: real 0.015s user 0.014s sys 0.002s
I20260808 23:37:04.315001 12240 ts_tablet_manager.cc:1428] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec: Time spent starting tablet: real 0.017s user 0.014s sys 0.002s
I20260808 23:37:04.372469 12247 raft_consensus.cc:482] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:37:04.372805 12247 raft_consensus.cc:504] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } } peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } }
I20260808 23:37:04.374845 12247 leader_election.cc:288] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b001d67e3754ffab5134e5ecd42d24a (127.26.207.194:43563), b1045037db4d4614b4c73e07d0d2a912 (127.26.207.195:40069)
W20260808 23:37:04.378731 11928 tablet.cc:2369] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:37:04.384084 12236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.375426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:49047 (local address 127.26.207.194:43563)
0808 23:37:04.375658 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:04.375665 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:04.376570 (+ 905us) server_negotiation.cc:407] Connection header received
0808 23:37:04.376930 (+ 360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:04.376939 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:04.377037 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:04.377148 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:37:04.377812 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.378597 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.381329 (+ 2732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.382844 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.383084 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.383179 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:04.383612 (+ 433us) server_negotiation.cc:299] Negotiation successful
0808 23:37:04.383740 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 23:37:04.384174 12249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.375126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:43563 (local address 127.26.207.193:49047)
0808 23:37:04.376394 (+ 1268us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:04.376420 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 23:37:04.376673 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:37:04.377175 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:37:04.377180 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:37:04.377216 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:37:04.377637 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:04.377651 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.378757 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.378762 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:04.381114 (+ 2352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:04.381133 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.383154 (+ 2021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.383159 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:04.383313 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.383391 (+ 78us) client_negotiation.cc:769] Sending connection context
0808 23:37:04.383540 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 23:37:04.383714 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1087,"thread_start_us":1271,"threads_started":1}
I20260808 23:37:04.384369 12237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.375435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:33883 (local address 127.26.207.195:40069)
0808 23:37:04.375689 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:04.375698 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:04.376975 (+ 1277us) server_negotiation.cc:407] Connection header received
0808 23:37:04.377187 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:04.377192 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:04.377277 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:04.377533 (+ 256us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:37:04.378181 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.379407 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.381837 (+ 2430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.383264 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.383436 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.383531 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:04.383907 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 23:37:04.384065 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 23:37:04.385031 12248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.375561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:40069 (local address 127.26.207.193:33883)
0808 23:37:04.376842 (+ 1281us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:04.376868 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 23:37:04.377016 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:37:04.377526 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:37:04.377532 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:37:04.377569 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:37:04.377991 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:04.378003 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.379585 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.379591 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:04.381602 (+ 2011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:04.381614 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.383533 (+ 1919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.383539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:04.383718 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.383750 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 23:37:04.383851 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 23:37:04.384006 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1101,"thread_start_us":439,"threads_started":1}
I20260808 23:37:04.385718 12025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "981dd8ee5efe4b7c946c8fc7e65add10" candidate_uuid: "98579751614e4390af7c16894897d4ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b001d67e3754ffab5134e5ecd42d24a" is_pre_election: true
I20260808 23:37:04.386415 12025 raft_consensus.cc:2454] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98579751614e4390af7c16894897d4ec in term 0.
I20260808 23:37:04.386283 12172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "981dd8ee5efe4b7c946c8fc7e65add10" candidate_uuid: "98579751614e4390af7c16894897d4ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1045037db4d4614b4c73e07d0d2a912" is_pre_election: true
I20260808 23:37:04.386888 12172 raft_consensus.cc:2454] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98579751614e4390af7c16894897d4ec in term 0.
I20260808 23:37:04.387329 11805 leader_election.cc:302] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b001d67e3754ffab5134e5ecd42d24a, 98579751614e4390af7c16894897d4ec; no voters:
I20260808 23:37:04.387876 12247 raft_consensus.cc:2781] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:37:04.388139 12247 raft_consensus.cc:482] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:37:04.388304 12247 raft_consensus.cc:3037] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:37:04.390805 12247 raft_consensus.cc:504] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } } peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } }
I20260808 23:37:04.391620 12247 leader_election.cc:288] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [CANDIDATE]: Term 1 election: Requested vote from peers 3b001d67e3754ffab5134e5ecd42d24a (127.26.207.194:43563), b1045037db4d4614b4c73e07d0d2a912 (127.26.207.195:40069)
I20260808 23:37:04.392287 12025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "981dd8ee5efe4b7c946c8fc7e65add10" candidate_uuid: "98579751614e4390af7c16894897d4ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b001d67e3754ffab5134e5ecd42d24a"
I20260808 23:37:04.392364 12172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "981dd8ee5efe4b7c946c8fc7e65add10" candidate_uuid: "98579751614e4390af7c16894897d4ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1045037db4d4614b4c73e07d0d2a912"
I20260808 23:37:04.392582 12172 raft_consensus.cc:3037] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:37:04.392582 12025 raft_consensus.cc:3037] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:37:04.396166 12172 raft_consensus.cc:2454] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98579751614e4390af7c16894897d4ec in term 1.
I20260808 23:37:04.396171 12025 raft_consensus.cc:2454] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98579751614e4390af7c16894897d4ec in term 1.
I20260808 23:37:04.396806 11805 leader_election.cc:302] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b001d67e3754ffab5134e5ecd42d24a, 98579751614e4390af7c16894897d4ec; no voters:
I20260808 23:37:04.397248 12247 raft_consensus.cc:2781] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:37:04.397802 12247 raft_consensus.cc:686] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [term 1 LEADER]: Becoming Leader. State: Replica: 98579751614e4390af7c16894897d4ec, State: Running, Role: LEADER
I20260808 23:37:04.398356 12247 consensus_queue.cc:237] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } } peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } }
W20260808 23:37:04.404266 12221 tablet.cc:2369] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:37:04.404126 11714 catalog_manager.cc:5495] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 98579751614e4390af7c16894897d4ec (127.26.207.193). New cstate: current_term: 1 leader_uuid: "98579751614e4390af7c16894897d4ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } health_report { overall_health: UNKNOWN } } }
I20260808 23:37:04.426826 12235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.420412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45862 (local address 127.26.207.193:43593)
0808 23:37:04.420665 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:04.420670 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:04.420691 (+ 21us) server_negotiation.cc:407] Connection header received
0808 23:37:04.420977 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:04.420983 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:04.421105 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:04.421254 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:37:04.421734 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.422511 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.424105 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.424652 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.424856 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.425533 (+ 677us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:37:04.426103 (+ 570us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:37:04.426228 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:04.426399 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 23:37:04.426484 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260808 23:37:04.437048 12025 raft_consensus.cc:1261] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a [term 1 FOLLOWER]: Refusing update from remote peer 98579751614e4390af7c16894897d4ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:37:04.437048 12172 raft_consensus.cc:1261] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912 [term 1 FOLLOWER]: Refusing update from remote peer 98579751614e4390af7c16894897d4ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:37:04.438714 12247 consensus_queue.cc:1035] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:37:04.439208 12250 consensus_queue.cc:1035] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:37:04.474506 11714 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41198:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:37:04.474845 11714 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41198:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:37:04.479185 11714 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Sending DeleteTablet for 3 replicas of tablet 981dd8ee5efe4b7c946c8fc7e65add10
I20260808 23:37:04.480858 11856 tablet_service.cc:1514] Processing DeleteTablet for tablet 981dd8ee5efe4b7c946c8fc7e65add10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:37:04 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:45854
I20260808 23:37:04.480967 12148 tablet_service.cc:1514] Processing DeleteTablet for tablet 981dd8ee5efe4b7c946c8fc7e65add10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:37:04 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:47530
I20260808 23:37:04.480871 12003 tablet_service.cc:1514] Processing DeleteTablet for tablet 981dd8ee5efe4b7c946c8fc7e65add10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:37:04 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:36374
I20260808 23:37:04.482849 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 11785
I20260808 23:37:04.493163 12266 tablet_replica.cc:330] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec: stopping tablet replica
I20260808 23:37:04.493922 12265 tablet_replica.cc:330] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912: stopping tablet replica
I20260808 23:37:04.494645 12264 tablet_replica.cc:330] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a: stopping tablet replica
I20260808 23:37:04.495188 12265 raft_consensus.cc:2229] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:37:04.495241 12264 raft_consensus.cc:2229] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:37:04.495949 12264 raft_consensus.cc:2258] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:37:04.495945 12265 raft_consensus.cc:2258] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:37:04.497066 12266 raft_consensus.cc:2229] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:37:04.497910 12266 raft_consensus.cc:2258] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:37:04.498907 12265 ts_tablet_manager.cc:1905] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:37:04.503156 12266 ts_tablet_manager.cc:1905] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:37:04.507508 12265 ts_tablet_manager.cc:1918] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:37:04.507866 12265 log.cc:1196] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/981dd8ee5efe4b7c946c8fc7e65add10
I20260808 23:37:04.508635 12265 ts_tablet_manager.cc:1939] T 981dd8ee5efe4b7c946c8fc7e65add10 P b1045037db4d4614b4c73e07d0d2a912: Deleting consensus metadata
I20260808 23:37:04.511296 12264 ts_tablet_manager.cc:1905] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:37:04.511670 11699 catalog_manager.cc:4841] TS b1045037db4d4614b4c73e07d0d2a912 (127.26.207.195:40069): tablet 981dd8ee5efe4b7c946c8fc7e65add10 (table test-table [id=6c8cbc58542c4ebba9d7fcb05c48cb1e]) successfully deleted
Aug 08 23:37:04 dist-test-slave-1x4g krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:37:04.520241 12264 ts_tablet_manager.cc:1918] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:37:04.520583 12264 log.cc:1196] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/981dd8ee5efe4b7c946c8fc7e65add10
I20260808 23:37:04.521284 12264 ts_tablet_manager.cc:1939] T 981dd8ee5efe4b7c946c8fc7e65add10 P 3b001d67e3754ffab5134e5ecd42d24a: Deleting consensus metadata
I20260808 23:37:04.523336 11701 catalog_manager.cc:4841] TS 3b001d67e3754ffab5134e5ecd42d24a (127.26.207.194:43563): tablet 981dd8ee5efe4b7c946c8fc7e65add10 (table test-table [id=6c8cbc58542c4ebba9d7fcb05c48cb1e]) successfully deleted
I20260808 23:37:04.525986 12266 ts_tablet_manager.cc:1918] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:37:04.526273 12266 log.cc:1196] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/981dd8ee5efe4b7c946c8fc7e65add10
I20260808 23:37:04.527011 12266 ts_tablet_manager.cc:1939] T 981dd8ee5efe4b7c946c8fc7e65add10 P 98579751614e4390af7c16894897d4ec: Deleting consensus metadata
I20260808 23:37:04.527245 12235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.484585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45878 (local address 127.26.207.193:43593)
0808 23:37:04.484905 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:04.484913 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:04.491724 (+ 6811us) server_negotiation.cc:407] Connection header received
0808 23:37:04.494053 (+ 2329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:04.494060 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:04.494164 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:04.494296 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:04.496876 (+ 2580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.498154 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.507963 (+ 9809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.508856 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.509033 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.516288 (+ 7255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:04.516320 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:04.516342 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:04.516414 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:04.521106 (+ 4692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:04.523949 (+ 2843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:04.523963 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:04.523967 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:04.524196 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:04.524874 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:04.524879 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:04.524882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:04.525412 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:04.525714 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:04.526458 (+ 744us) server_negotiation.cc:299] Negotiation successful
0808 23:37:04.526749 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 23:37:04.529104 11922 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:37:04.529512 11699 catalog_manager.cc:4841] TS 98579751614e4390af7c16894897d4ec (127.26.207.193:43593): tablet 981dd8ee5efe4b7c946c8fc7e65add10 (table test-table [id=6c8cbc58542c4ebba9d7fcb05c48cb1e]) successfully deleted
I20260808 23:37:04.633010 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 11785
I20260808 23:37:04.658537 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 11933
Aug 08 23:37:04 dist-test-slave-1x4g krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:37:04.675832 12236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.659442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36388 (local address 127.26.207.194:43563)
0808 23:37:04.659666 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:04.659672 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:04.659695 (+ 23us) server_negotiation.cc:407] Connection header received
0808 23:37:04.659828 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:04.659833 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:04.659912 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:04.660034 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:04.661653 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.662438 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.663903 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.664338 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.664487 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.669419 (+ 4932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:04.669443 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:04.669471 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:04.669540 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:04.672600 (+ 3060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:04.673491 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:04.673500 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:04.673503 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:04.673662 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:04.674103 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:04.674114 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:04.674116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:04.674533 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:04.674882 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:04.675203 (+ 321us) server_negotiation.cc:299] Negotiation successful
0808 23:37:04.675453 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 23:37:04.676654 12069 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:37:04.770205 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 11933
I20260808 23:37:04.792868 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 12080
Aug 08 23:37:04 dist-test-slave-1x4g krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:37:04.815093 12237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:04.793744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47540 (local address 127.26.207.195:40069)
0808 23:37:04.793964 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:04.793971 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:04.793992 (+ 21us) server_negotiation.cc:407] Connection header received
0808 23:37:04.794178 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:04.794184 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:04.794266 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:04.794385 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:04.795825 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.796598 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.798104 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:04.798524 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:04.798680 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:04.808345 (+ 9665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:04.808366 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:04.808384 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:04.808435 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:04.811653 (+ 3218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:04.812658 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:04.812666 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:04.812669 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:04.812896 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:04.813351 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:04.813356 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:04.813360 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:04.813777 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:04.814117 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:04.814452 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 23:37:04.814711 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 23:37:04.815798 12214 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:37:04.915148 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 12080
I20260808 23:37:04.938916 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 11682
I20260808 23:37:04.940315 11750 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:37:05.057276 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 11682
I20260808 23:37:25.085837 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:34615
--webserver_interface=127.26.207.254
--webserver_port=39911
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:43625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:34615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:37:25.472286 12274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:37:25.472615 12274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:37:25.472843 12274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:37:25.480705 12274 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 23:37:25.480909 12274 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 23:37:25.480989 12274 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 23:37:25.481098 12274 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:37:25.481206 12274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:37:25.481312 12274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:37:25.481382 12274 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:37:25.481456 12274 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:37:25.492273 12274 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:34615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:34615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=39911
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:37:25.493829 12274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:37:25.495327 12274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:37:25.524472 12283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:25.524519 12282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:25.524573 12285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:37:25.531026 12274 server_base.cc:1034] running on GCE node
I20260808 23:37:25.532284 12274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:37:25.534264 12274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:37:25.535581 12274 hybrid_clock.cc:648] HybridClock initialized: now 1786232245535498 us; error 45 us; skew 500 ppm
I20260808 23:37:25.536128 12274 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:37:25 dist-test-slave-1x4g krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232245, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:37:25.540584 12274 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:37:25.542886 12274 webserver.cc:460] Webserver started at http://127.26.207.254:39911/ using document root <none> and password file <none>
I20260808 23:37:25.544160 12274 fs_manager.cc:359] Metadata directory not provided
I20260808 23:37:25.544376 12274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:37:25.551860 12274 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 23:37:25.555773 12294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:25.557942 12274 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 23:37:25.558239 12274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "6a51dd41cca54939bb7a54f94219841e"
format_stamp: "Formatted at 2026-08-08 23:37:02 on dist-test-slave-1x4g"
server_key: "fbf2284637a65cda0c82429a85cfe9a5"
server_key_iv: "c8aad6ba3e4fcaabb8867d8c449e1d46"
server_key_version: "encryptionkey@0"
I20260808 23:37:25.559594 12274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:37:25.592023 12274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:37:25.597807 12274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:37:25.598188 12274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:37:25.620716 12274 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:34615
I20260808 23:37:25.620759 12352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:34615 every 8 connection(s)
I20260808 23:37:25.622598 12274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:37:25.625686 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 12274
I20260808 23:37:25.626929 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:43593
--local_ip_for_outbound_sockets=127.26.207.193
--tserver_master_addrs=127.26.207.254:34615
--webserver_port=37385
--webserver_interface=127.26.207.193
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:43625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:37:25.634362 12353 sys_catalog.cc:263] Verifying existing consensus state
I20260808 23:37:25.640625 12353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Bootstrap starting.
I20260808 23:37:25.665139 12353 log.cc:824] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Log is configured to *not* fsync() on all Append() calls
I20260808 23:37:25.680558 12353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 23:37:25.681234 12353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Bootstrap complete.
I20260808 23:37:25.691774 12353 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } }
I20260808 23:37:25.693434 12353 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a51dd41cca54939bb7a54f94219841e, State: Initialized, Role: FOLLOWER
I20260808 23:37:25.694216 12353 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } }
I20260808 23:37:25.694516 12353 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:37:25.694685 12353 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:37:25.694891 12353 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 1 FOLLOWER]: Advancing to term 2
I20260808 23:37:25.699617 12353 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } }
I20260808 23:37:25.700312 12353 leader_election.cc:302] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a51dd41cca54939bb7a54f94219841e; no voters:
I20260808 23:37:25.701145 12353 leader_election.cc:288] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 23:37:25.701325 12357 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 2 FOLLOWER]: Leader election won for term 2
I20260808 23:37:25.702605 12357 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 2 LEADER]: Becoming Leader. State: Replica: 6a51dd41cca54939bb7a54f94219841e, State: Running, Role: LEADER
I20260808 23:37:25.703382 12357 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } }
I20260808 23:37:25.703980 12353 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:37:25.706295 12359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a51dd41cca54939bb7a54f94219841e. Latest consensus state: current_term: 2 leader_uuid: "6a51dd41cca54939bb7a54f94219841e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } } }
I20260808 23:37:25.706822 12359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [sys.catalog]: This master's current role is: LEADER
I20260808 23:37:25.708043 12358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6a51dd41cca54939bb7a54f94219841e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } } }
I20260808 23:37:25.708402 12358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [sys.catalog]: This master's current role is: LEADER
I20260808 23:37:25.717664 12363 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:37:25.728096 12363 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:37:25.730063 12363 catalog_manager.cc:1259] Loaded cluster ID: 3dff933a1e9a4f829038a0e55b5fbf5d
I20260808 23:37:25.730286 12363 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:37:25.734966 12363 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:37:25.737267 12363 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Loaded TSK: 0
I20260808 23:37:25.781760 12363 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Generated new TSK 1
I20260808 23:37:25.782469 12363 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 23:37:26.034246 12355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:37:26.034621 12355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:37:26.034788 12355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:37:26.042968 12355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:37:26.043162 12355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:37:26.043336 12355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:37:26.054343 12355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:43593
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=37385
--tserver_master_addrs=127.26.207.254:34615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:37:26.055933 12355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:37:26.057518 12355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:37:26.075415 12380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:26.075480 12381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:26.077581 12383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:37:26.079798 12355 server_base.cc:1034] running on GCE node
I20260808 23:37:26.080868 12355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:37:26.082039 12355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:37:26.083300 12355 hybrid_clock.cc:648] HybridClock initialized: now 1786232246083224 us; error 77 us; skew 500 ppm
I20260808 23:37:26.083670 12355 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:37:26 dist-test-slave-1x4g krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232246, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:37:26.087414 12355 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:37:26.089303 12355 webserver.cc:460] Webserver started at http://127.26.207.193:37385/ using document root <none> and password file <none>
I20260808 23:37:26.090092 12355 fs_manager.cc:359] Metadata directory not provided
I20260808 23:37:26.090253 12355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:37:26.096909 12355 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.004s
I20260808 23:37:26.100090 12391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:26.101740 12355 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:37:26.101943 12355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "98579751614e4390af7c16894897d4ec"
format_stamp: "Formatted at 2026-08-08 23:37:02 on dist-test-slave-1x4g"
server_key: "42c1a30fccdec56c614dffa011241f44"
server_key_iv: "c34bc9b486bad7656da629f534b31ef1"
server_key_version: "encryptionkey@0"
I20260808 23:37:26.103075 12355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:37:26.126294 12355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:37:26.131614 12355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:37:26.131961 12355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:37:26.133203 12355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:37:26.135510 12355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:37:26.135663 12355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:26.135799 12355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:37:26.135895 12355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:26.176900 12355 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:43593
I20260808 23:37:26.176992 12511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:43593 every 8 connection(s)
I20260808 23:37:26.178593 12355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:37:26.188302 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 12355
I20260808 23:37:26.189182 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:43563
--local_ip_for_outbound_sockets=127.26.207.194
--tserver_master_addrs=127.26.207.254:34615
--webserver_port=42229
--webserver_interface=127.26.207.194
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:43625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 23:37:26 dist-test-slave-1x4g krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232246, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:37:26.208885 12515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:26.181963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:35893)
0808 23:37:26.182771 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:26.182809 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 23:37:26.184609 (+ 1800us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:37:26.186056 (+ 1447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:37:26.186064 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:37:26.186624 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:37:26.187197 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:26.187217 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:26.189905 (+ 2688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:26.189911 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:26.191618 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:26.191637 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:26.193470 (+ 1833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:26.193481 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:26.193852 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:26.194800 (+ 948us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:37:26.194848 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:37:26.198464 (+ 3616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:37:26.203389 (+ 4925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:37:26.203397 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:37:26.203411 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:37:26.203916 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:37:26.204583 (+ 667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:37:26.204587 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:37:26.204590 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:37:26.204922 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:37:26.206134 (+ 1212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:37:26.206141 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:37:26.206614 (+ 473us) client_negotiation.cc:769] Sending connection context
0808 23:37:26.206920 (+ 306us) client_negotiation.cc:240] Negotiation successful
0808 23:37:26.207468 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":338,"threads_started":1}
I20260808 23:37:26.209308 12514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:26.181755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:35893 (local address 127.26.207.254:34615)
0808 23:37:26.182486 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:26.182505 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:26.182952 (+ 447us) server_negotiation.cc:407] Connection header received
0808 23:37:26.185208 (+ 2256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:26.185222 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:26.185585 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:26.185898 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:26.187439 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:26.189671 (+ 2232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:26.191819 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:26.193143 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:26.193388 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:26.198899 (+ 5511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:26.198915 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:26.198941 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:26.199014 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:26.203149 (+ 4135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:26.204108 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:26.204123 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:26.204135 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:26.204400 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:26.205052 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:26.205061 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:26.205068 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:26.205928 (+ 860us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:26.206166 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:26.207242 (+ 1076us) server_negotiation.cc:299] Negotiation successful
0808 23:37:26.207782 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":272,"threads_started":1}
I20260808 23:37:26.212442 12512 heartbeater.cc:347] Connected to a master server at 127.26.207.254:34615
I20260808 23:37:26.212905 12512 heartbeater.cc:464] Registering TS with master...
I20260808 23:37:26.214079 12512 heartbeater.cc:511] Master 127.26.207.254:34615 requested a full tablet report, sending...
I20260808 23:37:26.216871 12314 ts_manager.cc:194] Registered new tserver with Master: 98579751614e4390af7c16894897d4ec (127.26.207.193:43593)
I20260808 23:37:26.218741 12314 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:35893
W20260808 23:37:26.571822 12516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:37:26.572212 12516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:37:26.572387 12516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:37:26.580088 12516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:37:26.580281 12516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:37:26.580482 12516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:37:26.591291 12516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:43563
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=42229
--tserver_master_addrs=127.26.207.254:34615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:37:26.592885 12516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:37:26.594343 12516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:37:26.609561 12521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:26.609549 12524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:26.609578 12522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:37:26.611057 12516 server_base.cc:1034] running on GCE node
I20260808 23:37:26.611794 12516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:37:26.612929 12516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:37:26.614149 12516 hybrid_clock.cc:648] HybridClock initialized: now 1786232246614084 us; error 63 us; skew 500 ppm
I20260808 23:37:26.614506 12516 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:37:26 dist-test-slave-1x4g krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232246, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:37:26.618221 12516 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:37:26.620332 12516 webserver.cc:460] Webserver started at http://127.26.207.194:42229/ using document root <none> and password file <none>
I20260808 23:37:26.621213 12516 fs_manager.cc:359] Metadata directory not provided
I20260808 23:37:26.621390 12516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:37:26.627832 12516 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 23:37:26.631340 12532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:26.633072 12516 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:37:26.633276 12516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "3b001d67e3754ffab5134e5ecd42d24a"
format_stamp: "Formatted at 2026-08-08 23:37:03 on dist-test-slave-1x4g"
server_key: "b2dcd32a53ffd83d191c3d6742ebc6b8"
server_key_iv: "5310dba5870328dbca0640b8924b5ec5"
server_key_version: "encryptionkey@0"
I20260808 23:37:26.634378 12516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:37:26.654867 12516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:37:26.659605 12516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:37:26.659917 12516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:37:26.661124 12516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:37:26.662738 12516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:37:26.662858 12516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:26.663012 12516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:37:26.663097 12516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:26.700150 12516 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:43563
I20260808 23:37:26.700251 12655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:43563 every 8 connection(s)
I20260808 23:37:26.701829 12516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:37:26.709993 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 12516
I20260808 23:37:26.710673 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:40069
--local_ip_for_outbound_sockets=127.26.207.195
--tserver_master_addrs=127.26.207.254:34615
--webserver_port=41097
--webserver_interface=127.26.207.195
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:43625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 23:37:26 dist-test-slave-1x4g krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232246, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:37:26.724433 12514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:26.704741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:49463 (local address 127.26.207.254:34615)
0808 23:37:26.704966 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:26.704971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:26.706230 (+ 1259us) server_negotiation.cc:407] Connection header received
0808 23:37:26.708401 (+ 2171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:26.708406 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:26.708546 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:26.708666 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:26.710643 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:26.711444 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:26.713223 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:26.713682 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:26.713823 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:26.718090 (+ 4267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:26.718097 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:26.718100 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:26.718142 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:26.720965 (+ 2823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:26.721869 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:26.721874 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:26.721877 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:26.722022 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:26.722523 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:26.722527 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:26.722529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:26.722834 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:26.723003 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:26.723784 (+ 781us) server_negotiation.cc:299] Negotiation successful
0808 23:37:26.724060 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 23:37:26.725625 12658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:26.705212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:49463)
0808 23:37:26.706032 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:26.706086 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 23:37:26.708049 (+ 1963us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:37:26.708987 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:37:26.708998 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:37:26.709618 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:37:26.710413 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:26.710445 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:26.711639 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:26.711643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:26.713052 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:26.713068 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:26.713964 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:26.713973 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:26.714228 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:26.715006 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:37:26.715037 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:37:26.717766 (+ 2729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:37:26.721168 (+ 3402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:37:26.721184 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:37:26.721200 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:37:26.721709 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:37:26.722150 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:37:26.722156 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:37:26.722159 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:37:26.722379 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:37:26.722975 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:37:26.722983 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:37:26.723388 (+ 405us) client_negotiation.cc:769] Sending connection context
0808 23:37:26.723680 (+ 292us) client_negotiation.cc:240] Negotiation successful
0808 23:37:26.724298 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":358,"threads_started":1}
I20260808 23:37:26.727377 12656 heartbeater.cc:347] Connected to a master server at 127.26.207.254:34615
I20260808 23:37:26.727819 12656 heartbeater.cc:464] Registering TS with master...
I20260808 23:37:26.728909 12656 heartbeater.cc:511] Master 127.26.207.254:34615 requested a full tablet report, sending...
I20260808 23:37:26.730918 12314 ts_manager.cc:194] Registered new tserver with Master: 3b001d67e3754ffab5134e5ecd42d24a (127.26.207.194:43563)
I20260808 23:37:26.732342 12314 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:49463
W20260808 23:37:27.091995 12659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:37:27.092315 12659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:37:27.092415 12659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:37:27.100294 12659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:37:27.100435 12659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:37:27.100557 12659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:37:27.111428 12659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:40069
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=41097
--tserver_master_addrs=127.26.207.254:34615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:37:27.112883 12659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:37:27.114266 12659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:37:27.128592 12667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:27.128563 12666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:27.129283 12669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:37:27.134717 12659 server_base.cc:1034] running on GCE node
I20260808 23:37:27.135529 12659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:37:27.136569 12659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:37:27.137843 12659 hybrid_clock.cc:648] HybridClock initialized: now 1786232247137792 us; error 90 us; skew 500 ppm
I20260808 23:37:27.138298 12659 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:37:27 dist-test-slave-1x4g krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232247, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:37:27.142271 12659 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:37:27.144057 12659 webserver.cc:460] Webserver started at http://127.26.207.195:41097/ using document root <none> and password file <none>
I20260808 23:37:27.145112 12659 fs_manager.cc:359] Metadata directory not provided
I20260808 23:37:27.145339 12659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:37:27.151612 12659 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 23:37:27.155007 12678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:27.156554 12659 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 23:37:27.156865 12659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "b1045037db4d4614b4c73e07d0d2a912"
format_stamp: "Formatted at 2026-08-08 23:37:04 on dist-test-slave-1x4g"
server_key: "ae3d1b52d94baabbfbd7a052cf873d9c"
server_key_iv: "4be0e4e1dfe6e852ccc1178d4543b424"
server_key_version: "encryptionkey@0"
I20260808 23:37:27.158085 12659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:37:27.178586 12659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:37:27.184044 12659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:37:27.184294 12659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:37:27.185377 12659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:37:27.186791 12659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:37:27.186906 12659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:27.186998 12659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:37:27.187054 12659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:27.223912 12512 heartbeater.cc:503] Master 127.26.207.254:34615 was elected leader, sending a full tablet report...
I20260808 23:37:27.227411 12659 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:40069
I20260808 23:37:27.227466 12799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:40069 every 8 connection(s)
I20260808 23:37:27.229086 12659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:37:27.239315 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 12659
Aug 08 23:37:27 dist-test-slave-1x4g krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232247, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:37:27.254876 12802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.232151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:40697 (local address 127.26.207.254:34615)
0808 23:37:27.232704 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:27.232709 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:27.233663 (+ 954us) server_negotiation.cc:407] Connection header received
0808 23:37:27.235727 (+ 2064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:27.235732 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:27.235831 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:27.235966 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:27.237782 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.238710 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.241124 (+ 2414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.241868 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.242040 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.246749 (+ 4709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:27.246755 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:27.246759 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:27.246815 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:27.250819 (+ 4004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:27.252120 (+ 1301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:27.252124 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:27.252126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:27.252263 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:27.252811 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:27.252818 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:27.252821 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:27.253154 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:27.253322 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:27.254140 (+ 818us) server_negotiation.cc:299] Negotiation successful
0808 23:37:27.254469 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":303,"threads_started":1}
I20260808 23:37:27.256124 12803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.232672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:40697)
0808 23:37:27.233487 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:27.233532 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 23:37:27.235399 (+ 1867us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:37:27.236248 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:37:27.236257 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:37:27.236940 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:37:27.237576 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:27.237595 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.238949 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.238954 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:27.240866 (+ 1912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:27.240901 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.242133 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.242139 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:27.242406 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.243166 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:37:27.243192 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:37:27.246442 (+ 3250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:37:27.251089 (+ 4647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:37:27.251101 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:37:27.251121 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:37:27.251929 (+ 808us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:37:27.252402 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:37:27.252407 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:37:27.252411 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:37:27.252650 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:37:27.253295 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:37:27.253304 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:37:27.253749 (+ 445us) client_negotiation.cc:769] Sending connection context
0808 23:37:27.254041 (+ 292us) client_negotiation.cc:240] Negotiation successful
0808 23:37:27.254684 (+ 643us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":292,"threads_started":1}
I20260808 23:37:27.257822 12805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.240433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38892 (local address 127.26.207.254:34615)
0808 23:37:27.241400 (+ 967us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:27.241405 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:27.241444 (+ 39us) server_negotiation.cc:407] Connection header received
0808 23:37:27.241492 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:27.241495 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:27.241566 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:27.241657 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:27.243550 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.244832 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.246703 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.247204 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.247313 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.251188 (+ 3875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:27.251199 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:27.251205 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:27.251253 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:27.254532 (+ 3279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:27.255597 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:27.255606 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:27.255612 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:27.255757 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:27.256175 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:27.256181 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:27.256184 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:27.256528 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:27.256890 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:27.257185 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 23:37:27.257465 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":846,"thread_start_us":669,"threads_started":1}
I20260808 23:37:27.258111 12800 heartbeater.cc:347] Connected to a master server at 127.26.207.254:34615
I20260808 23:37:27.258466 12800 heartbeater.cc:464] Registering TS with master...
I20260808 23:37:27.259307 12800 heartbeater.cc:511] Master 127.26.207.254:34615 requested a full tablet report, sending...
I20260808 23:37:27.260893 12314 ts_manager.cc:194] Registered new tserver with Master: b1045037db4d4614b4c73e07d0d2a912 (127.26.207.195:40069)
I20260808 23:37:27.261768 12314 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:40697
I20260808 23:37:27.273857 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:37:27.281612 12805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.274985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38894 (local address 127.26.207.254:34615)
0808 23:37:27.275249 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:27.275259 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:27.275625 (+ 366us) server_negotiation.cc:407] Connection header received
0808 23:37:27.275822 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:27.275827 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:27.276015 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:27.276160 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:37:27.276725 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.277553 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.279336 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.279815 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.279940 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.280571 (+ 631us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:37:27.280977 (+ 406us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 23:37:27.281338 (+ 361us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38894: token expired
Metrics: {"server-negotiator.queue_time_us":84}
W20260808 23:37:27.281781 12805 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38894: token expired
W20260808 23:37:27.282413 12224 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.207.254:34615)
I20260808 23:37:27.298998 12805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.282960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38898 (local address 127.26.207.254:34615)
0808 23:37:27.283169 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:27.283173 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:27.283190 (+ 17us) server_negotiation.cc:407] Connection header received
0808 23:37:27.283338 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:27.283341 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:27.283406 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:27.283502 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:27.285186 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.286187 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.287824 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.288294 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.288437 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.291751 (+ 3314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:27.291757 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:27.291760 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:27.291807 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:27.294987 (+ 3180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:27.296227 (+ 1240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:27.296234 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:27.296236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:27.296479 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:27.297284 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:27.297289 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:27.297292 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:27.297720 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:27.297944 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:27.298383 (+ 439us) server_negotiation.cc:299] Negotiation successful
0808 23:37:27.298632 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 23:37:27.303156 12314 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38898:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:37:27.311667 12314 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:37:27.346251 12815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.327214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44632 (local address 127.26.207.194:43563)
0808 23:37:27.328673 (+ 1459us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:27.328687 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:27.331321 (+ 2634us) server_negotiation.cc:407] Connection header received
0808 23:37:27.331489 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:27.331514 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:27.331876 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:27.332148 (+ 272us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:37:27.335310 (+ 3162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.339713 (+ 4403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.342870 (+ 3157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.344286 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.344472 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.344685 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:27.345643 (+ 958us) server_negotiation.cc:299] Negotiation successful
0808 23:37:27.345842 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1234,"thread_start_us":1070,"threads_started":1}
I20260808 23:37:27.346289 12816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.326609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:43563 (local address 127.0.0.1:44632)
0808 23:37:27.330886 (+ 4277us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:27.330915 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 23:37:27.331126 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:37:27.332545 (+ 1419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:37:27.332557 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:37:27.332601 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:37:27.334978 (+ 2377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:27.334998 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.339967 (+ 4969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.339977 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:27.342689 (+ 2712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:27.342701 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.344966 (+ 2265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.344974 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:27.345311 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.345397 (+ 86us) client_negotiation.cc:769] Sending connection context
0808 23:37:27.345551 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 23:37:27.345806 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4094,"thread_start_us":12743,"threads_started":1}
I20260808 23:37:27.349793 12812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.325776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:40069 (local address 127.0.0.1:47408)
0808 23:37:27.327478 (+ 1702us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:27.327555 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0808 23:37:27.327790 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:37:27.341693 (+ 13903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:37:27.341697 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:37:27.341722 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:37:27.342324 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:27.342347 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.344446 (+ 2099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.344454 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:27.347086 (+ 2632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:27.347111 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.348759 (+ 1648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.348766 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:27.348978 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.349028 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 23:37:27.349152 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 23:37:27.349309 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1349,"mutex_wait_us":140,"thread_start_us":1169,"threads_started":1}
I20260808 23:37:27.350307 12813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.326104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47408 (local address 127.26.207.195:40069)
0808 23:37:27.341040 (+ 14936us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:27.341048 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:27.341084 (+ 36us) server_negotiation.cc:407] Connection header received
0808 23:37:27.341189 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:27.341199 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:27.341414 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:27.342250 (+ 836us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:37:27.342629 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.344264 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.347331 (+ 3067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.348503 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.348748 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.348974 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:27.349212 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 23:37:27.349382 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14766,"thread_start_us":14576,"threads_started":1}
I20260808 23:37:27.350477 12814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.327877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:43593 (local address 127.0.0.1:47794)
0808 23:37:27.339693 (+ 11816us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:27.339718 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 23:37:27.339890 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:37:27.341395 (+ 1505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:37:27.341401 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:37:27.341440 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:37:27.341860 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:27.341875 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.344157 (+ 2282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.344163 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:27.347224 (+ 3061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:27.347236 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.349530 (+ 2294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.349537 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:27.349734 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.349774 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 23:37:27.349883 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 23:37:27.350033 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11671,"mutex_wait_us":96,"thread_start_us":2645,"threads_started":1}
I20260808 23:37:27.351227 12817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.328434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47794 (local address 127.26.207.193:43593)
0808 23:37:27.340588 (+ 12154us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:27.340599 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:27.340638 (+ 39us) server_negotiation.cc:407] Connection header received
0808 23:37:27.340764 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:27.340799 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:27.341137 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:27.341382 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:37:27.342166 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.343947 (+ 1781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.347376 (+ 3429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.348920 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.349152 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.349316 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:27.350725 (+ 1409us) server_negotiation.cc:299] Negotiation successful
0808 23:37:27.350918 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11957,"thread_start_us":11805,"threads_started":1}
I20260808 23:37:27.351310 12585 tablet_service.cc:1467] Processing CreateTablet for tablet 8811680601f44dd9b199c4ec000261b4 (DEFAULT_TABLE table=test-table [id=f9381d1605af4fa78c77c56f18e0d97d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:37:27.352692 12585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8811680601f44dd9b199c4ec000261b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:37:27.356357 12730 tablet_service.cc:1467] Processing CreateTablet for tablet 8811680601f44dd9b199c4ec000261b4 (DEFAULT_TABLE table=test-table [id=f9381d1605af4fa78c77c56f18e0d97d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:37:27.356742 12445 tablet_service.cc:1467] Processing CreateTablet for tablet 8811680601f44dd9b199c4ec000261b4 (DEFAULT_TABLE table=test-table [id=f9381d1605af4fa78c77c56f18e0d97d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:37:27.358306 12445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8811680601f44dd9b199c4ec000261b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:37:27.358317 12730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8811680601f44dd9b199c4ec000261b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:37:27.371060 12818 tablet_bootstrap.cc:492] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a: Bootstrap starting.
I20260808 23:37:27.373679 12819 tablet_bootstrap.cc:492] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912: Bootstrap starting.
I20260808 23:37:27.375839 12818 tablet_bootstrap.cc:654] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a: Neither blocks nor log segments found. Creating new log.
I20260808 23:37:27.375871 12820 tablet_bootstrap.cc:492] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec: Bootstrap starting.
I20260808 23:37:27.377792 12819 tablet_bootstrap.cc:654] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912: Neither blocks nor log segments found. Creating new log.
I20260808 23:37:27.377770 12818 log.cc:824] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a: Log is configured to *not* fsync() on all Append() calls
I20260808 23:37:27.379227 12819 log.cc:824] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912: Log is configured to *not* fsync() on all Append() calls
I20260808 23:37:27.380311 12820 tablet_bootstrap.cc:654] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec: Neither blocks nor log segments found. Creating new log.
I20260808 23:37:27.381608 12820 log.cc:824] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec: Log is configured to *not* fsync() on all Append() calls
I20260808 23:37:27.382550 12818 tablet_bootstrap.cc:492] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a: No bootstrap required, opened a new log
I20260808 23:37:27.382609 12819 tablet_bootstrap.cc:492] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912: No bootstrap required, opened a new log
I20260808 23:37:27.382887 12818 ts_tablet_manager.cc:1397] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260808 23:37:27.382886 12819 ts_tablet_manager.cc:1397] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 23:37:27.384490 12820 tablet_bootstrap.cc:492] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec: No bootstrap required, opened a new log
I20260808 23:37:27.384852 12820 ts_tablet_manager.cc:1397] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260808 23:37:27.394106 12820 raft_consensus.cc:348] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } } peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } }
I20260808 23:37:27.394667 12820 raft_consensus.cc:374] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:37:27.394783 12820 raft_consensus.cc:729] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98579751614e4390af7c16894897d4ec, State: Initialized, Role: FOLLOWER
I20260808 23:37:27.395587 12820 consensus_queue.cc:260] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } } peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } }
I20260808 23:37:27.395640 12819 raft_consensus.cc:348] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } } peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } }
I20260808 23:37:27.395640 12818 raft_consensus.cc:348] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } } peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } }
I20260808 23:37:27.396219 12819 raft_consensus.cc:374] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:37:27.396217 12818 raft_consensus.cc:374] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:37:27.396392 12819 raft_consensus.cc:729] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1045037db4d4614b4c73e07d0d2a912, State: Initialized, Role: FOLLOWER
I20260808 23:37:27.396378 12818 raft_consensus.cc:729] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b001d67e3754ffab5134e5ecd42d24a, State: Initialized, Role: FOLLOWER
I20260808 23:37:27.397403 12819 consensus_queue.cc:260] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } } peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } }
I20260808 23:37:27.397403 12818 consensus_queue.cc:260] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } } peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } }
I20260808 23:37:27.399080 12820 ts_tablet_manager.cc:1428] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec: Time spent starting tablet: real 0.014s user 0.011s sys 0.002s
I20260808 23:37:27.400728 12656 heartbeater.cc:503] Master 127.26.207.254:34615 was elected leader, sending a full tablet report...
I20260808 23:37:27.401188 12819 ts_tablet_manager.cc:1428] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912: Time spent starting tablet: real 0.018s user 0.020s sys 0.000s
I20260808 23:37:27.401337 12818 ts_tablet_manager.cc:1428] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a: Time spent starting tablet: real 0.018s user 0.020s sys 0.000s
I20260808 23:37:27.403142 12800 heartbeater.cc:503] Master 127.26.207.254:34615 was elected leader, sending a full tablet report...
I20260808 23:37:27.409895 12826 raft_consensus.cc:482] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:37:27.410188 12826 raft_consensus.cc:504] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } } peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } }
I20260808 23:37:27.412057 12826 leader_election.cc:288] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1045037db4d4614b4c73e07d0d2a912 (127.26.207.195:40069), 98579751614e4390af7c16894897d4ec (127.26.207.193:43593)
I20260808 23:37:27.423483 12817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.413945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:53673 (local address 127.26.207.193:43593)
0808 23:37:27.414237 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:27.414245 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:27.414516 (+ 271us) server_negotiation.cc:407] Connection header received
0808 23:37:27.414668 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:27.414674 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:27.414777 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:27.414900 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:37:27.415534 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.416682 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.420266 (+ 3584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.421820 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.422069 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.422167 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:27.422977 (+ 810us) server_negotiation.cc:299] Negotiation successful
0808 23:37:27.423178 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260808 23:37:27.423480 12813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.412911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:46967 (local address 127.26.207.195:40069)
0808 23:37:27.413263 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:27.413272 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:27.413540 (+ 268us) server_negotiation.cc:407] Connection header received
0808 23:37:27.413967 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:27.413975 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:27.414088 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:27.414187 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:37:27.415389 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.416683 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.420251 (+ 3568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.421820 (+ 1569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.422068 (+ 248us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.422167 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:27.423025 (+ 858us) server_negotiation.cc:299] Negotiation successful
0808 23:37:27.423213 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260808 23:37:27.423879 12828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.412355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:40069 (local address 127.26.207.194:46967)
0808 23:37:27.413314 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:27.413351 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 23:37:27.413662 (+ 311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:37:27.414697 (+ 1035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:37:27.414702 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:37:27.414732 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:37:27.415189 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:27.415202 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.416928 (+ 1726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.416935 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:27.419920 (+ 2985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:27.419952 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.422238 (+ 2286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.422247 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:27.422568 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.422708 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 23:37:27.422950 (+ 242us) client_negotiation.cc:240] Negotiation successful
0808 23:37:27.423255 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":796,"mutex_wait_us":379,"thread_start_us":503,"threads_started":1}
I20260808 23:37:27.423907 12829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.413532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:43593 (local address 127.26.207.194:53673)
0808 23:37:27.414320 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:27.414339 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:37:27.414521 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:37:27.414915 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:37:27.414918 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:37:27.414937 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:37:27.415352 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:27.415360 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.416928 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.416935 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:27.419920 (+ 2985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:37:27.419952 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.422238 (+ 2286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.422247 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:37:27.422570 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.422709 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 23:37:27.422937 (+ 228us) client_negotiation.cc:240] Negotiation successful
0808 23:37:27.423255 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"mutex_wait_us":279,"thread_start_us":392,"threads_started":1}
I20260808 23:37:27.425226 12750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8811680601f44dd9b199c4ec000261b4" candidate_uuid: "3b001d67e3754ffab5134e5ecd42d24a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1045037db4d4614b4c73e07d0d2a912" is_pre_election: true
I20260808 23:37:27.425225 12467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8811680601f44dd9b199c4ec000261b4" candidate_uuid: "3b001d67e3754ffab5134e5ecd42d24a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98579751614e4390af7c16894897d4ec" is_pre_election: true
I20260808 23:37:27.426095 12750 raft_consensus.cc:2454] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b001d67e3754ffab5134e5ecd42d24a in term 0.
I20260808 23:37:27.426092 12467 raft_consensus.cc:2454] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b001d67e3754ffab5134e5ecd42d24a in term 0.
I20260808 23:37:27.426944 12534 leader_election.cc:302] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b001d67e3754ffab5134e5ecd42d24a, 98579751614e4390af7c16894897d4ec; no voters:
I20260808 23:37:27.427436 12826 raft_consensus.cc:2781] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:37:27.427646 12826 raft_consensus.cc:482] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:37:27.427757 12826 raft_consensus.cc:3037] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:37:27.430819 12826 raft_consensus.cc:504] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } } peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } }
W20260808 23:37:27.431339 12513 tablet.cc:2369] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:37:27.431645 12826 leader_election.cc:288] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [CANDIDATE]: Term 1 election: Requested vote from peers b1045037db4d4614b4c73e07d0d2a912 (127.26.207.195:40069), 98579751614e4390af7c16894897d4ec (127.26.207.193:43593)
I20260808 23:37:27.432279 12750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8811680601f44dd9b199c4ec000261b4" candidate_uuid: "3b001d67e3754ffab5134e5ecd42d24a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1045037db4d4614b4c73e07d0d2a912"
I20260808 23:37:27.432286 12467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8811680601f44dd9b199c4ec000261b4" candidate_uuid: "3b001d67e3754ffab5134e5ecd42d24a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98579751614e4390af7c16894897d4ec"
I20260808 23:37:27.432552 12467 raft_consensus.cc:3037] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:37:27.432546 12750 raft_consensus.cc:3037] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:37:27.436201 12467 raft_consensus.cc:2454] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b001d67e3754ffab5134e5ecd42d24a in term 1.
I20260808 23:37:27.436201 12750 raft_consensus.cc:2454] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b001d67e3754ffab5134e5ecd42d24a in term 1.
I20260808 23:37:27.436870 12534 leader_election.cc:302] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b001d67e3754ffab5134e5ecd42d24a, b1045037db4d4614b4c73e07d0d2a912; no voters:
I20260808 23:37:27.437242 12826 raft_consensus.cc:2781] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:37:27.438002 12826 raft_consensus.cc:686] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [term 1 LEADER]: Becoming Leader. State: Replica: 3b001d67e3754ffab5134e5ecd42d24a, State: Running, Role: LEADER
I20260808 23:37:27.438699 12826 consensus_queue.cc:237] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } } peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } }
I20260808 23:37:27.444403 12311 catalog_manager.cc:5495] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b001d67e3754ffab5134e5ecd42d24a (127.26.207.194). New cstate: current_term: 1 leader_uuid: "3b001d67e3754ffab5134e5ecd42d24a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b001d67e3754ffab5134e5ecd42d24a" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 43563 } health_report { overall_health: HEALTHY } } }
W20260808 23:37:27.454267 12657 tablet.cc:2369] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:37:27.469875 12815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.463304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44636 (local address 127.26.207.194:43563)
0808 23:37:27.463549 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:27.463558 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:27.463696 (+ 138us) server_negotiation.cc:407] Connection header received
0808 23:37:27.463957 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:27.463961 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:27.464059 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:27.464258 (+ 199us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:37:27.464723 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.465553 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.467106 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.467525 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.467633 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.468464 (+ 831us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:37:27.469183 (+ 719us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:37:27.469300 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:27.469471 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 23:37:27.469553 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 23:37:27.479389 12750 raft_consensus.cc:1261] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912 [term 1 FOLLOWER]: Refusing update from remote peer 3b001d67e3754ffab5134e5ecd42d24a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:37:27.479389 12467 raft_consensus.cc:1261] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec [term 1 FOLLOWER]: Refusing update from remote peer 3b001d67e3754ffab5134e5ecd42d24a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:37:27.480556 12830 consensus_queue.cc:1035] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "98579751614e4390af7c16894897d4ec" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 23:37:27.480993 12801 tablet.cc:2369] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:37:27.481159 12826 consensus_queue.cc:1035] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1045037db4d4614b4c73e07d0d2a912" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:37:27.512102 12311 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:37:27.512465 12311 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:37:27.516860 12311 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Sending DeleteTablet for 3 replicas of tablet 8811680601f44dd9b199c4ec000261b4
I20260808 23:37:27.518371 12730 tablet_service.cc:1514] Processing DeleteTablet for tablet 8811680601f44dd9b199c4ec000261b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:37:27 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:47408
I20260808 23:37:27.518343 12585 tablet_service.cc:1514] Processing DeleteTablet for tablet 8811680601f44dd9b199c4ec000261b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:37:27 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:44632
I20260808 23:37:27.518906 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 12355
I20260808 23:37:27.519218 12445 tablet_service.cc:1514] Processing DeleteTablet for tablet 8811680601f44dd9b199c4ec000261b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:37:27 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:47794
I20260808 23:37:27.520145 12844 tablet_replica.cc:330] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a: stopping tablet replica
I20260808 23:37:27.520692 12844 raft_consensus.cc:2229] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:37:27.521492 12844 raft_consensus.cc:2258] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:37:27.522339 12843 tablet_replica.cc:330] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912: stopping tablet replica
I20260808 23:37:27.523221 12843 raft_consensus.cc:2229] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:37:27.523814 12843 raft_consensus.cc:2258] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:37:27.526352 12843 ts_tablet_manager.cc:1905] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:37:27.529645 12844 ts_tablet_manager.cc:1905] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:37:27.534504 12843 ts_tablet_manager.cc:1918] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:37:27.534714 12843 log.cc:1196] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/8811680601f44dd9b199c4ec000261b4
I20260808 23:37:27.535401 12843 ts_tablet_manager.cc:1939] T 8811680601f44dd9b199c4ec000261b4 P b1045037db4d4614b4c73e07d0d2a912: Deleting consensus metadata
I20260808 23:37:27.536058 12845 tablet_replica.cc:330] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec: stopping tablet replica
I20260808 23:37:27.536593 12845 raft_consensus.cc:2229] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:37:27.537211 12845 raft_consensus.cc:2258] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:37:27.537704 12296 catalog_manager.cc:4841] TS b1045037db4d4614b4c73e07d0d2a912 (127.26.207.195:40069): tablet 8811680601f44dd9b199c4ec000261b4 (table test-table [id=f9381d1605af4fa78c77c56f18e0d97d]) successfully deleted
I20260808 23:37:27.540593 12845 ts_tablet_manager.cc:1905] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:37:27.542933 12844 ts_tablet_manager.cc:1918] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:37:27.543135 12844 log.cc:1196] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/8811680601f44dd9b199c4ec000261b4
I20260808 23:37:27.543316 12817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.520279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47800 (local address 127.26.207.193:43593)
0808 23:37:27.520956 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:27.520962 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:27.520982 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:37:27.521044 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:27.521052 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:27.521138 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:27.521239 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:27.524120 (+ 2881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.525358 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.527457 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.528141 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.528274 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.532559 (+ 4285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:27.532584 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:27.532604 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:27.532664 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:27.538157 (+ 5493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:27.539319 (+ 1162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:27.539329 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:27.539332 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:27.539521 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:27.540046 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:27.540053 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:27.540057 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:27.540542 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:27.542253 (+ 1711us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:27.542412 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 23:37:27.542691 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528}
I20260808 23:37:27.543810 12844 ts_tablet_manager.cc:1939] T 8811680601f44dd9b199c4ec000261b4 P 3b001d67e3754ffab5134e5ecd42d24a: Deleting consensus metadata
I20260808 23:37:27.544353 12507 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:37:27.545943 12298 catalog_manager.cc:4841] TS 3b001d67e3754ffab5134e5ecd42d24a (127.26.207.194:43563): tablet 8811680601f44dd9b199c4ec000261b4 (table test-table [id=f9381d1605af4fa78c77c56f18e0d97d]) successfully deleted
I20260808 23:37:27.638561 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 12355
W20260808 23:37:27.661197 12296 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.207.193:43593 (error 108)
I20260808 23:37:27.661516 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 12516
I20260808 23:37:27.663954 12814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.663331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:43593 (local address 127.0.0.1:47806)
0808 23:37:27.663619 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:27.663743 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:43593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164}
W20260808 23:37:27.664268 12296 catalog_manager.cc:4584] TS 98579751614e4390af7c16894897d4ec (127.26.207.193:43593): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8811680601f44dd9b199c4ec000261b4: Network error: Client connection negotiation failed: client connection to 127.26.207.193:43593: connect: Connection refused (error 111)
I20260808 23:37:27.677538 12815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.662536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44644 (local address 127.26.207.194:43563)
0808 23:37:27.662746 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:27.662753 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:27.662862 (+ 109us) server_negotiation.cc:407] Connection header received
0808 23:37:27.663093 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:27.663098 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:27.663195 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:27.663309 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:27.665046 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.665888 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.667242 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.667698 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.667840 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.670886 (+ 3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:27.670903 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:27.670919 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:27.670958 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:27.674268 (+ 3310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:27.675094 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:27.675102 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:27.675105 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:27.675274 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:27.675734 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:27.675743 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:27.675746 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:27.676158 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:27.676542 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:27.676895 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 23:37:27.677162 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 23:37:27.678411 12651 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:37:27.718118 12814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.717475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:43593 (local address 127.0.0.1:47816)
0808 23:37:27.717740 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:27.717871 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:43593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260808 23:37:27.719374 12814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.718924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:43593 (local address 127.0.0.1:47818)
0808 23:37:27.719097 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:27.719215 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:43593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 23:37:27.780324 12814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.779754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:43593 (local address 127.0.0.1:47828)
0808 23:37:27.780032 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:27.780135 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:43593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260808 23:37:27.781781 12814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.781344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:43593 (local address 127.0.0.1:47844)
0808 23:37:27.781544 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:27.781635 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:43593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260808 23:37:27.800957 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 12516
I20260808 23:37:27.825845 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 12659
I20260808 23:37:27.840318 12813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.826609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47416 (local address 127.26.207.195:40069)
0808 23:37:27.826803 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 23:37:27.826809 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:37:27.826833 (+ 24us) server_negotiation.cc:407] Connection header received
0808 23:37:27.826989 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:37:27.826993 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:37:27.827076 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:37:27.827169 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:37:27.828697 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.829608 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.830985 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:37:27.831451 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:37:27.831560 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:37:27.834500 (+ 2940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:37:27.834520 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:37:27.834538 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:37:27.834578 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:37:27.837663 (+ 3085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:27.838478 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:27.838485 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:27.838488 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:27.838630 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:37:27.838971 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:37:27.838974 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:37:27.838976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:37:27.839344 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:37:27.839601 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0808 23:37:27.839855 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 23:37:27.840037 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 23:37:27.841187 12795 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:37:27.862527 12814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.861946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:43593 (local address 127.0.0.1:47858)
0808 23:37:27.862204 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:27.862325 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:43593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 23:37:27.863813 12814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:27.863342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:43593 (local address 127.0.0.1:47864)
0808 23:37:27.863556 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:27.863654 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.193:43593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260808 23:37:27.934793 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 12659
I20260808 23:37:27.956384 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 12274
I20260808 23:37:27.957741 12347 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:37:28.079644 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 12274
I20260808 23:37:48.108906 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:34615
--webserver_interface=127.26.207.254
--webserver_port=39911
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:43625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:34615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:37:48.490768 12853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:37:48.491114 12853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:37:48.491288 12853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:37:48.499356 12853 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 23:37:48.499504 12853 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 23:37:48.499581 12853 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 23:37:48.499666 12853 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:37:48.499768 12853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:37:48.499872 12853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:37:48.499919 12853 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:37:48.499970 12853 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:37:48.511006 12853 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:34615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:34615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=39911
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:37:48.512589 12853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:37:48.514114 12853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:37:48.527884 12862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:48.527961 12859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:48.527984 12864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:37:48.528515 12853 server_base.cc:1034] running on GCE node
I20260808 23:37:48.529552 12853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:37:48.531209 12853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:37:48.532497 12853 hybrid_clock.cc:648] HybridClock initialized: now 1786232268532408 us; error 68 us; skew 500 ppm
I20260808 23:37:48.532954 12853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:37:48 dist-test-slave-1x4g krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232268, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:37:48.536532 12853 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:37:48.538355 12853 webserver.cc:460] Webserver started at http://127.26.207.254:39911/ using document root <none> and password file <none>
I20260808 23:37:48.539212 12853 fs_manager.cc:359] Metadata directory not provided
I20260808 23:37:48.539374 12853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:37:48.546074 12853 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 23:37:48.549670 12872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:48.551388 12853 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 23:37:48.551659 12853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "6a51dd41cca54939bb7a54f94219841e"
format_stamp: "Formatted at 2026-08-08 23:37:02 on dist-test-slave-1x4g"
server_key: "fbf2284637a65cda0c82429a85cfe9a5"
server_key_iv: "c8aad6ba3e4fcaabb8867d8c449e1d46"
server_key_version: "encryptionkey@0"
I20260808 23:37:48.552855 12853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:37:48.571846 12853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:37:48.577016 12853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:37:48.577353 12853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:37:48.597627 12853 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:34615
I20260808 23:37:48.597659 12926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:34615 every 8 connection(s)
I20260808 23:37:48.599403 12853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:37:48.604465 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 12853
I20260808 23:37:48.605405 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:43593
--local_ip_for_outbound_sockets=127.26.207.193
--tserver_master_addrs=127.26.207.254:34615
--webserver_port=37385
--webserver_interface=127.26.207.193
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:43625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:37:48.607102 12927 sys_catalog.cc:263] Verifying existing consensus state
I20260808 23:37:48.610759 12927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Bootstrap starting.
I20260808 23:37:48.633936 12927 log.cc:824] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Log is configured to *not* fsync() on all Append() calls
I20260808 23:37:48.653095 12927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 23:37:48.653755 12927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Bootstrap complete.
I20260808 23:37:48.663945 12927 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } }
I20260808 23:37:48.665091 12927 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a51dd41cca54939bb7a54f94219841e, State: Initialized, Role: FOLLOWER
I20260808 23:37:48.665771 12927 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } }
I20260808 23:37:48.666054 12927 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:37:48.666203 12927 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:37:48.666401 12927 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 2 FOLLOWER]: Advancing to term 3
I20260808 23:37:48.670897 12927 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } }
I20260808 23:37:48.671507 12927 leader_election.cc:302] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a51dd41cca54939bb7a54f94219841e; no voters:
I20260808 23:37:48.672263 12927 leader_election.cc:288] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 23:37:48.672418 12931 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 3 FOLLOWER]: Leader election won for term 3
I20260808 23:37:48.673655 12931 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [term 3 LEADER]: Becoming Leader. State: Replica: 6a51dd41cca54939bb7a54f94219841e, State: Running, Role: LEADER
I20260808 23:37:48.674286 12931 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } }
I20260808 23:37:48.674767 12927 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:37:48.677017 12933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a51dd41cca54939bb7a54f94219841e. Latest consensus state: current_term: 3 leader_uuid: "6a51dd41cca54939bb7a54f94219841e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } } }
I20260808 23:37:48.677605 12933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [sys.catalog]: This master's current role is: LEADER
I20260808 23:37:48.677525 12932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "6a51dd41cca54939bb7a54f94219841e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a51dd41cca54939bb7a54f94219841e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 34615 } } }
I20260808 23:37:48.677946 12932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e [sys.catalog]: This master's current role is: LEADER
I20260808 23:37:48.686829 12938 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:37:48.696717 12938 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:37:48.698411 12938 catalog_manager.cc:1259] Loaded cluster ID: 3dff933a1e9a4f829038a0e55b5fbf5d
I20260808 23:37:48.698565 12938 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:37:48.702896 12938 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:37:48.704909 12938 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Loaded TSK: 0
I20260808 23:37:48.705113 12938 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6a51dd41cca54939bb7a54f94219841e: Loaded TSK: 1
F20260808 23:37:48.706452 12938 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f1df71c09ad google::LogMessage::Fail() at ??:0
@ 0x7f1df71c388a google::LogMessage::SendToLog() at ??:0
@ 0x7f1df71c04de google::LogMessage::Flush() at ??:0
@ 0x7f1df71c1a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f1dfaf247d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f1dfaf1373e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f1e0cbef1c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f1e0cbee783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f1e0cc7a2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f1e0cc7a0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f1e0ccc45e9 std::function<>::operator()() at ??:0
@ 0x7f1e0cbf2cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f1e0cbf0c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f1e0cc78610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f1e0cc78439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f1df9e0c345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f1df9e0f91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f1df9e0f799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f1df9deaeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f1dfd0c46db start_thread at ??:0
@ 0x7f1df605a61f clone at ??:0
W20260808 23:37:49.081802 12929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:37:49.082139 12929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:37:49.082243 12929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:37:49.090569 12929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:37:49.090727 12929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:37:49.090850 12929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:37:49.101689 12929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:43593
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=37385
--tserver_master_addrs=127.26.207.254:34615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:37:49.103200 12929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:37:49.104622 12929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:37:49.119536 12984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:49.119609 12980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:49.119606 12982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:37:49.120968 12929 server_base.cc:1034] running on GCE node
I20260808 23:37:49.121764 12929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:37:49.122932 12929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:37:49.124243 12929 hybrid_clock.cc:648] HybridClock initialized: now 1786232269124178 us; error 58 us; skew 500 ppm
I20260808 23:37:49.124683 12929 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:37:49 dist-test-slave-1x4g krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232269, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:37:49.128527 12929 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:37:49.130302 12929 webserver.cc:460] Webserver started at http://127.26.207.193:37385/ using document root <none> and password file <none>
I20260808 23:37:49.131103 12929 fs_manager.cc:359] Metadata directory not provided
I20260808 23:37:49.131240 12929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:37:49.137653 12929 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 23:37:49.141265 12991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:49.142884 12929 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 23:37:49.143126 12929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "98579751614e4390af7c16894897d4ec"
format_stamp: "Formatted at 2026-08-08 23:37:02 on dist-test-slave-1x4g"
server_key: "42c1a30fccdec56c614dffa011241f44"
server_key_iv: "c34bc9b486bad7656da629f534b31ef1"
server_key_version: "encryptionkey@0"
I20260808 23:37:49.144269 12929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:37:49.171970 12929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:37:49.177894 12929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:37:49.178262 12929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:37:49.179792 12929 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:37:49.182132 12999 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260808 23:37:49.188700 12999 ts_tablet_manager.cc:1852] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260808 23:37:49.189949 12999 ts_tablet_manager.cc:1905] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:37:49.198764 12999 ts_tablet_manager.cc:1918] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:37:49.199046 12999 log.cc:1196] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/8811680601f44dd9b199c4ec000261b4
I20260808 23:37:49.199585 12999 ts_tablet_manager.cc:1939] T 8811680601f44dd9b199c4ec000261b4 P 98579751614e4390af7c16894897d4ec: Deleting consensus metadata
I20260808 23:37:49.200080 12929 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260808 23:37:49.200243 12929 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.019s user 0.001s sys 0.000s
I20260808 23:37:49.200417 12929 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:37:49.200492 12929 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:49.240176 12929 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:43593
I20260808 23:37:49.240278 13111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:43593 every 8 connection(s)
I20260808 23:37:49.241743 12929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:37:49.245951 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 12929
I20260808 23:37:49.246855 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:43563
--local_ip_for_outbound_sockets=127.26.207.194
--tserver_master_addrs=127.26.207.254:34615
--webserver_port=42229
--webserver_interface=127.26.207.194
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:43625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:37:49.247910 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:49.245145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:49669)
0808 23:37:49.246239 (+ 1094us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:49.246565 (+ 326us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":374,"threads_started":1}
W20260808 23:37:49.248816 13112 heartbeater.cc:644] Failed to heartbeat to 127.26.207.254:34615 (0 consecutive failures): Network error: Failed to ping master at 127.26.207.254:34615: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
I20260808 23:37:49.250233 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:49.249740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:59073)
0808 23:37:49.249961 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:49.250065 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 23:37:49.251365 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:49.250890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:47225)
0808 23:37:49.251076 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:49.251186 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 23:37:49.251623 13112 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 23:37:49.625162 13115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:37:49.625506 13115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:37:49.625739 13115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:37:49.633647 13115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:37:49.633786 13115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:37:49.633980 13115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:37:49.644680 13115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:43563
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=42229
--tserver_master_addrs=127.26.207.254:34615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:37:49.646256 13115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:37:49.647809 13115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:37:49.664494 13120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:49.664428 13121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:49.664462 13123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:37:49.665537 13115 server_base.cc:1034] running on GCE node
I20260808 23:37:49.666348 13115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:37:49.667574 13115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:37:49.668944 13115 hybrid_clock.cc:648] HybridClock initialized: now 1786232269668869 us; error 44 us; skew 500 ppm
I20260808 23:37:49.669366 13115 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:37:49 dist-test-slave-1x4g krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232269, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:37:49.673336 13115 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:37:49.675191 13115 webserver.cc:460] Webserver started at http://127.26.207.194:42229/ using document root <none> and password file <none>
I20260808 23:37:49.676017 13115 fs_manager.cc:359] Metadata directory not provided
I20260808 23:37:49.676191 13115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:37:49.682703 13115 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20260808 23:37:49.686275 13131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:49.687950 13115 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 23:37:49.688192 13115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "3b001d67e3754ffab5134e5ecd42d24a"
format_stamp: "Formatted at 2026-08-08 23:37:03 on dist-test-slave-1x4g"
server_key: "b2dcd32a53ffd83d191c3d6742ebc6b8"
server_key_iv: "5310dba5870328dbca0640b8924b5ec5"
server_key_version: "encryptionkey@0"
I20260808 23:37:49.689507 13115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:37:49.717056 13115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:37:49.722272 13115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:37:49.722612 13115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:37:49.723769 13115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:37:49.725345 13115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:37:49.725490 13115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:49.725632 13115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:37:49.725723 13115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:49.763576 13115 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:43563
I20260808 23:37:49.763675 13256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:43563 every 8 connection(s)
I20260808 23:37:49.765281 13115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:37:49.771556 13259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:49.768767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:41361)
0808 23:37:49.770160 (+ 1393us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:49.770447 (+ 287us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":825,"thread_start_us":508,"threads_started":1}
W20260808 23:37:49.772594 13257 heartbeater.cc:644] Failed to heartbeat to 127.26.207.254:34615 (0 consecutive failures): Network error: Failed to ping master at 127.26.207.254:34615: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
I20260808 23:37:49.773388 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 13115
I20260808 23:37:49.773886 13259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:49.773398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:59021)
0808 23:37:49.773660 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:49.773749 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260808 23:37:49.774245 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:40069
--local_ip_for_outbound_sockets=127.26.207.195
--tserver_master_addrs=127.26.207.254:34615
--webserver_port=41097
--webserver_interface=127.26.207.195
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:43625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:37:49.775050 13259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:49.774618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:35203)
0808 23:37:49.774809 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:49.774904 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260808 23:37:49.775373 13257 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 23:37:50.142130 13260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:37:50.142444 13260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:37:50.142630 13260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:37:50.150617 13260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:37:50.150749 13260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:37:50.150938 13260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:37:50.161960 13260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:40069
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=41097
--tserver_master_addrs=127.26.207.254:34615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:37:50.163497 13260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:37:50.164975 13260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:37:50.179885 13265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:50.179876 13266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:37:50.179920 13268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:37:50.181277 13260 server_base.cc:1034] running on GCE node
I20260808 23:37:50.181988 13260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:37:50.183054 13260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:37:50.184267 13260 hybrid_clock.cc:648] HybridClock initialized: now 1786232270184218 us; error 39 us; skew 500 ppm
I20260808 23:37:50.184626 13260 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:37:50 dist-test-slave-1x4g krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232270, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:37:50.188165 13260 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:37:50.189844 13260 webserver.cc:460] Webserver started at http://127.26.207.195:41097/ using document root <none> and password file <none>
I20260808 23:37:50.190681 13260 fs_manager.cc:359] Metadata directory not provided
I20260808 23:37:50.190852 13260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:37:50.196951 13260 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:37:50.199970 13275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:50.201694 13260 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:37:50.201926 13260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "b1045037db4d4614b4c73e07d0d2a912"
format_stamp: "Formatted at 2026-08-08 23:37:04 on dist-test-slave-1x4g"
server_key: "ae3d1b52d94baabbfbd7a052cf873d9c"
server_key_iv: "4be0e4e1dfe6e852ccc1178d4543b424"
server_key_version: "encryptionkey@0"
I20260808 23:37:50.203109 13260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:37:50.220144 13260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:37:50.224859 13260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:37:50.225183 13260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:37:50.226298 13260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:37:50.227798 13260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:37:50.227945 13260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:50.228092 13260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:37:50.228180 13260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:37:50.253659 13345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:50.252415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:33583)
0808 23:37:50.253292 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:50.253413 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":723,"thread_start_us":571,"threads_started":1}
I20260808 23:37:50.272768 13260 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:40069
I20260808 23:37:50.272899 13392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:40069 every 8 connection(s)
I20260808 23:37:50.274504 13260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:37:50.280092 13395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:50.278006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:41451)
0808 23:37:50.278842 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:50.279113 (+ 271us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":322,"threads_started":1}
W20260808 23:37:50.281024 13393 heartbeater.cc:644] Failed to heartbeat to 127.26.207.254:34615 (0 consecutive failures): Network error: Failed to ping master at 127.26.207.254:34615: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
I20260808 23:37:50.281970 13395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:50.281602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:37383)
0808 23:37:50.281770 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:50.281849 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 23:37:50.282634 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 13260
I20260808 23:37:50.283100 13395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:50.282689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:50577)
0808 23:37:50.282869 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:50.282953 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260808 23:37:50.284191 13393 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 23:37:50.777124 13397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:50.776023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:55819)
0808 23:37:50.776670 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:50.776834 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":335,"threads_started":1}
I20260808 23:37:51.255481 13398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:51.254688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:55815)
0808 23:37:51.255199 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:51.255298 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":291,"threads_started":1}
I20260808 23:37:51.285992 13399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:51.285055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:57969)
0808 23:37:51.285594 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:51.285721 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":281,"threads_started":1}
I20260808 23:37:51.779325 13400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:51.778286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:57759)
0808 23:37:51.778972 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:51.779094 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":379,"threads_started":1}
I20260808 23:37:52.257855 13401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:52.256870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:37773)
0808 23:37:52.257389 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:52.257654 (+ 265us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":254,"threads_started":1}
I20260808 23:37:52.288007 13402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:52.287180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:48321)
0808 23:37:52.287722 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:52.287821 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":279,"threads_started":1}
I20260808 23:37:52.781486 13403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:52.780377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:35701)
0808 23:37:52.781191 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:52.781289 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":388,"threads_started":1}
I20260808 23:37:53.259801 13404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:53.259029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:47625)
0808 23:37:53.259535 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:53.259625 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":247,"threads_started":1}
I20260808 23:37:53.290062 13406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:53.289195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:49595)
0808 23:37:53.289750 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:53.289864 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":315,"threads_started":1}
I20260808 23:37:53.783363 13407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:53.782560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:46623)
0808 23:37:53.783078 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:53.783175 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":251,"threads_started":1}
I20260808 23:37:54.262032 13408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:54.260995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:50667)
0808 23:37:54.261704 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:54.261845 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":452,"threads_started":1}
I20260808 23:37:54.292012 13409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:54.291205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:35993)
0808 23:37:54.291695 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:54.291817 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":243,"threads_started":1}
I20260808 23:37:54.785585 13410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:54.784538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:35497)
0808 23:37:54.785306 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:54.785400 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":525,"threads_started":1}
I20260808 23:37:55.264494 13411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:55.263101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:46007)
0808 23:37:55.264176 (+ 1075us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:55.264284 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":953,"thread_start_us":803,"threads_started":1}
I20260808 23:37:55.294178 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:55.293154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:46421)
0808 23:37:55.293874 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:55.293977 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":428,"threads_started":1}
I20260808 23:37:55.787469 13413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:55.786600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:33729)
0808 23:37:55.787193 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:55.787288 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":378,"threads_started":1}
I20260808 23:37:56.267112 13414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:56.265825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:34939)
0808 23:37:56.266785 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:56.266881 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":822,"thread_start_us":641,"threads_started":1}
I20260808 23:37:56.296118 13415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:56.295308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:51373)
0808 23:37:56.295826 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:56.295938 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":267,"threads_started":1}
I20260808 23:37:56.789747 13416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:56.788705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:51545)
0808 23:37:56.789412 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:56.789515 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":297,"threads_started":1}
I20260808 23:37:57.269212 13417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:57.268268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:38209)
0808 23:37:57.268925 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:57.269034 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":329,"threads_started":1}
I20260808 23:37:57.298014 13418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:57.297179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:60559)
0808 23:37:57.297696 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:57.297791 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":218,"threads_started":1}
I20260808 23:37:57.791774 13419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:57.790899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:49597)
0808 23:37:57.791508 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:57.791597 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":304,"threads_started":1}
I20260808 23:37:58.271587 13421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:58.270303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:44563)
0808 23:37:58.271186 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:58.271392 (+ 206us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":366,"threads_started":1}
I20260808 23:37:58.300125 13422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:58.299251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:54381)
0808 23:37:58.299812 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:58.299916 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":347,"threads_started":1}
I20260808 23:37:58.793970 13423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:58.792935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:35741)
0808 23:37:58.793593 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:58.793723 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":336,"threads_started":1}
I20260808 23:37:59.273713 13424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:59.272692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:40013)
0808 23:37:59.273383 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:59.273490 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":418,"threads_started":1}
I20260808 23:37:59.301968 13425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:59.301144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:44905)
0808 23:37:59.301669 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:59.301757 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":268,"threads_started":1}
I20260808 23:37:59.795912 13426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:37:59.795127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:41797)
0808 23:37:59.795646 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0808 23:37:59.795741 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":275,"threads_started":1}
I20260808 23:38:00.275799 13427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:00.274888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:60877)
0808 23:38:00.275486 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:00.275589 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":347,"threads_started":1}
I20260808 23:38:00.303941 13428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:00.303122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:42387)
0808 23:38:00.303649 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:00.303752 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":300,"threads_started":1}
I20260808 23:38:00.797926 13429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:00.797089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:52507)
0808 23:38:00.797608 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:00.797723 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":250,"threads_started":1}
I20260808 23:38:01.277860 13430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:01.277025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:41977)
0808 23:38:01.277584 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:01.277692 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":310,"threads_started":1}
I20260808 23:38:01.306125 13431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:01.305223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:43885)
0808 23:38:01.305826 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:01.305932 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":346,"threads_started":1}
I20260808 23:38:01.800050 13432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:01.799069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:32925)
0808 23:38:01.799674 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:01.799774 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":324,"threads_started":1}
I20260808 23:38:02.280210 13433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:02.279056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:33577)
0808 23:38:02.279738 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:02.279892 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":333,"threads_started":1}
I20260808 23:38:02.308176 13434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:02.307324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:39659)
0808 23:38:02.307908 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:02.308004 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":256,"threads_started":1}
I20260808 23:38:02.802013 13435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:02.801146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:41147)
0808 23:38:02.801699 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:02.801813 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":273,"threads_started":1}
I20260808 23:38:03.282457 13436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:03.281449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:38381)
0808 23:38:03.282029 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:03.282153 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":281,"threads_started":1}
I20260808 23:38:03.310248 13437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:03.309367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:42347)
0808 23:38:03.309901 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:03.310017 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":254,"threads_started":1}
I20260808 23:38:03.803993 13438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:03.803191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:56541)
0808 23:38:03.803681 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:03.803801 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":245,"threads_started":1}
I20260808 23:38:04.285204 13439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:04.284124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:33853)
0808 23:38:04.284733 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:04.284922 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":313,"threads_started":1}
I20260808 23:38:04.312040 13440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:04.311213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:41591)
0808 23:38:04.311740 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:04.311842 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":294,"threads_started":1}
I20260808 23:38:04.806265 13441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:04.805363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.194:47165)
0808 23:38:04.805909 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:04.806067 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":279,"threads_started":1}
I20260808 23:38:05.286019 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 12929
I20260808 23:38:05.288486 13442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:05.286562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.193:51091)
0808 23:38:05.287865 (+ 1303us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:05.288050 (+ 185us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1034,"thread_start_us":827,"threads_started":1}
I20260808 23:38:05.310997 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:05.288038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35560 (local address 127.26.207.193:43593)
0808 23:38:05.290065 (+ 2027us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:05.290088 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:05.290147 (+ 59us) server_negotiation.cc:407] Connection header received
0808 23:38:05.292990 (+ 2843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:05.293006 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:05.293546 (+ 540us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:05.294072 (+ 526us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:05.296054 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:05.297588 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:05.298989 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:05.299780 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:05.300033 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:05.303318 (+ 3285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:05.303329 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:05.303348 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:05.303407 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:05.306880 (+ 3473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:05.307802 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:05.307817 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:05.307825 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:05.308057 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:05.308537 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:05.308549 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:05.308553 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:05.309279 (+ 726us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:05.309622 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:05.310177 (+ 555us) server_negotiation.cc:299] Negotiation successful
0808 23:38:05.310672 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1750,"thread_start_us":1552,"threads_started":1}
I20260808 23:38:05.312655 13107 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:05.314342 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:05.313392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:34615 (local address 127.26.207.195:39223)
0808 23:38:05.313933 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:05.314079 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.254:34615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":302,"threads_started":1}
I20260808 23:38:05.408330 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 12929
I20260808 23:38:05.432902 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 13115
I20260808 23:38:05.454306 13446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:05.433981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34222 (local address 127.26.207.194:43563)
0808 23:38:05.434600 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:05.434621 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:05.434663 (+ 42us) server_negotiation.cc:407] Connection header received
0808 23:38:05.436390 (+ 1727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:05.436403 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:05.437010 (+ 607us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:05.437344 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:05.439078 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:05.440446 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:05.442084 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:05.442927 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:05.443109 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:05.446274 (+ 3165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:05.446284 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:05.446302 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:05.446369 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:05.450174 (+ 3805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:05.451160 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:05.451168 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:05.451177 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:05.451418 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:05.451908 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:05.451912 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:05.451914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:05.452572 (+ 658us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:05.452966 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:05.453441 (+ 475us) server_negotiation.cc:299] Negotiation successful
0808 23:38:05.453981 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":306,"threads_started":1}
I20260808 23:38:05.455905 13252 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:05.544760 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 13115
I20260808 23:38:05.568254 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 13260
I20260808 23:38:05.590101 13448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:05.569338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56300 (local address 127.26.207.195:40069)
0808 23:38:05.570005 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:05.570020 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:05.570069 (+ 49us) server_negotiation.cc:407] Connection header received
0808 23:38:05.571923 (+ 1854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:05.571935 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:05.572446 (+ 511us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:05.572872 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:05.574584 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:05.575995 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:05.577727 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:05.578536 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:05.578703 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:05.582048 (+ 3345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:05.582058 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:05.582078 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:05.582134 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:05.585943 (+ 3809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:05.586963 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:05.586972 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:05.586980 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:05.587215 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:05.587735 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:05.587739 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:05.587741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:05.588413 (+ 672us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:05.588681 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:05.589232 (+ 551us) server_negotiation.cc:299] Negotiation successful
0808 23:38:05.589739 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":336,"threads_started":1}
I20260808 23:38:05.591812 13388 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:05.678169 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 13260
2026-08-08T23:38:05Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65553 ms)
[----------] 30 tests from SecurityITest (321799 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:05 dist-test-slave-1x4g krb5kdc[13452](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:05 dist-test-slave-1x4g krb5kdc[13452](info): set up 2 sockets
Aug 08 23:38:05 dist-test-slave-1x4g krb5kdc[13452](info): commencing operation
krb5kdc: starting...
W20260808 23:38:06.877980 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.002s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:38:07 dist-test-slave-1x4g krb5kdc[13452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:38:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:38:07.233570 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:46383
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:46383
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:07.611332 13466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:07.611676 13466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:07.611773 13466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:07.619539 13466 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:07.619688 13466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:07.619737 13466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:07.619798 13466 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:07.619845 13466 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:07.631062 13466 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:46383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:46383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:07.632539 13466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:07.633977 13466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:07.647665 13472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:07.647720 13473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:07.647792 13475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:07.648590 13466 server_base.cc:1034] running on GCE node
I20260808 23:38:07.649566 13466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:07.651292 13466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:07.652580 13466 hybrid_clock.cc:648] HybridClock initialized: now 1786232287652513 us; error 79 us; skew 500 ppm
I20260808 23:38:07.653045 13466 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:07 dist-test-slave-1x4g krb5kdc[13452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232287, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:07.656849 13466 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:38:07.658653 13466 webserver.cc:460] Webserver started at http://127.26.207.254:40205/ using document root <none> and password file <none>
I20260808 23:38:07.659464 13466 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:07.659629 13466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:07.660012 13466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:07.663551 13466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "5f12e7604b1947e9b08278e1998f4a65"
format_stamp: "Formatted at 2026-08-08 23:38:07 on dist-test-slave-1x4g"
server_key: "1c040502e706fc909e5beab5284b339a"
server_key_iv: "3e827fbb66853e9699cffca194109d40"
server_key_version: "encryptionkey@0"
I20260808 23:38:07.664469 13466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "5f12e7604b1947e9b08278e1998f4a65"
format_stamp: "Formatted at 2026-08-08 23:38:07 on dist-test-slave-1x4g"
server_key: "1c040502e706fc909e5beab5284b339a"
server_key_iv: "3e827fbb66853e9699cffca194109d40"
server_key_version: "encryptionkey@0"
I20260808 23:38:07.670609 13466 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260808 23:38:07.675616 13482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:07.677402 13466 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260808 23:38:07.677660 13466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "5f12e7604b1947e9b08278e1998f4a65"
format_stamp: "Formatted at 2026-08-08 23:38:07 on dist-test-slave-1x4g"
server_key: "1c040502e706fc909e5beab5284b339a"
server_key_iv: "3e827fbb66853e9699cffca194109d40"
server_key_version: "encryptionkey@0"
I20260808 23:38:07.677914 13466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:07.716051 13466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:07.721035 13466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:07.721374 13466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:07.741946 13466 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:46383
I20260808 23:38:07.741972 13537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:46383 every 8 connection(s)
I20260808 23:38:07.743573 13466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:07.747823 13538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:07.750015 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 13466
I20260808 23:38:07.750259 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:07.750982 27455 external_mini_cluster.cc:1428] Setting key 362e2f28cd2cd6bab471c09f026119b0
I20260808 23:38:07.763996 13538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65: Bootstrap starting.
I20260808 23:38:07.768335 13538 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65: Neither blocks nor log segments found. Creating new log.
Aug 08 23:38:07 dist-test-slave-1x4g krb5kdc[13452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:38:07.769685 13538 log.cc:824] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:07.774279 13538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65: No bootstrap required, opened a new log
I20260808 23:38:07.782232 13541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:07.753334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50582 (local address 127.26.207.254:46383)
0808 23:38:07.754341 (+ 1007us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:07.754361 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:07.754423 (+ 62us) server_negotiation.cc:407] Connection header received
0808 23:38:07.757534 (+ 3111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:07.757582 (+ 48us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:07.758203 (+ 621us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:07.758789 (+ 586us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:07.760414 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:07.762892 (+ 2478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:07.764751 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:07.766034 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:07.766311 (+ 277us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:07.771196 (+ 4885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:07.771206 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:07.771224 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:07.771271 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:07.776223 (+ 4952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:07.777314 (+ 1091us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:07.777326 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:07.777337 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:07.777614 (+ 277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:07.778071 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:07.778077 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:07.778081 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:07.779008 (+ 927us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:07.779379 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:07.779858 (+ 479us) server_negotiation.cc:299] Negotiation successful
0808 23:38:07.780415 (+ 557us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":711,"thread_start_us":435,"threads_started":1}
I20260808 23:38:07.786732 13538 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f12e7604b1947e9b08278e1998f4a65" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46383 } }
I20260808 23:38:07.787168 13538 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:07.787256 13538 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f12e7604b1947e9b08278e1998f4a65, State: Initialized, Role: FOLLOWER
I20260808 23:38:07.787822 13538 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f12e7604b1947e9b08278e1998f4a65" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46383 } }
I20260808 23:38:07.788077 13538 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:07.788189 13538 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:07.788326 13538 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:07.791304 13538 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f12e7604b1947e9b08278e1998f4a65" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46383 } }
I20260808 23:38:07.791873 13538 leader_election.cc:302] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f12e7604b1947e9b08278e1998f4a65; no voters:
I20260808 23:38:07.792696 13538 leader_election.cc:288] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:07.792866 13543 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:07.793673 13543 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [term 1 LEADER]: Becoming Leader. State: Replica: 5f12e7604b1947e9b08278e1998f4a65, State: Running, Role: LEADER
I20260808 23:38:07.794369 13543 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f12e7604b1947e9b08278e1998f4a65" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46383 } }
I20260808 23:38:07.795596 13538 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:07.797830 13545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f12e7604b1947e9b08278e1998f4a65. Latest consensus state: current_term: 1 leader_uuid: "5f12e7604b1947e9b08278e1998f4a65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f12e7604b1947e9b08278e1998f4a65" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46383 } } }
I20260808 23:38:07.798353 13545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:07.798972 13544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f12e7604b1947e9b08278e1998f4a65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f12e7604b1947e9b08278e1998f4a65" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 46383 } } }
I20260808 23:38:07.799343 13544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:07.800942 13550 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:07.807353 13550 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:07.818076 13550 catalog_manager.cc:1347] Generated new cluster ID: 38c6afa06b5e465a8481004abf8ac232
I20260808 23:38:07.818264 13550 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:07.843457 13550 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:07.845628 13550 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:07.855959 13550 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65: Generated new TSK 0
I20260808 23:38:07.857111 13550 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:38:07.945129 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:46383
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:08.324985 13566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:08.325304 13566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:08.325404 13566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:08.333206 13566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:08.333341 13566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:08.333459 13566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:38:08.344143 13566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:46383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:08.345920 13566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:08.347304 13566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:08.362353 13574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:08.362460 13571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:08.362519 13572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:08.364009 13566 server_base.cc:1034] running on GCE node
I20260808 23:38:08.364723 13566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:08.365922 13566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:08.367165 13566 hybrid_clock.cc:648] HybridClock initialized: now 1786232288367091 us; error 74 us; skew 500 ppm
I20260808 23:38:08.367507 13566 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:08 dist-test-slave-1x4g krb5kdc[13452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232288, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:08.371234 13566 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:38:08.373131 13566 webserver.cc:460] Webserver started at http://127.26.207.193:42889/ using document root <none> and password file <none>
I20260808 23:38:08.373914 13566 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:08.374070 13566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:08.374445 13566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:08.377820 13566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "290f828f277f43dea4bf2c51b90bac49"
format_stamp: "Formatted at 2026-08-08 23:38:08 on dist-test-slave-1x4g"
server_key: "b83cd0b691c6a2dd129e53b56de84a6b"
server_key_iv: "0dcb9df3c1705a6d44efd19f09ee44ee"
server_key_version: "encryptionkey@0"
I20260808 23:38:08.378756 13566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "290f828f277f43dea4bf2c51b90bac49"
format_stamp: "Formatted at 2026-08-08 23:38:08 on dist-test-slave-1x4g"
server_key: "b83cd0b691c6a2dd129e53b56de84a6b"
server_key_iv: "0dcb9df3c1705a6d44efd19f09ee44ee"
server_key_version: "encryptionkey@0"
I20260808 23:38:08.385499 13566 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.002s
I20260808 23:38:08.390069 13582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:08.392458 13566 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 23:38:08.392948 13566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "290f828f277f43dea4bf2c51b90bac49"
format_stamp: "Formatted at 2026-08-08 23:38:08 on dist-test-slave-1x4g"
server_key: "b83cd0b691c6a2dd129e53b56de84a6b"
server_key_iv: "0dcb9df3c1705a6d44efd19f09ee44ee"
server_key_version: "encryptionkey@0"
I20260808 23:38:08.393260 13566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:08.410957 13566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:08.415920 13566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:08.416283 13566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:08.417516 13566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:08.419143 13566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:08.419227 13566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:08.419415 13566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:08.419484 13566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:08.456250 13566 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:43219
I20260808 23:38:08.456303 13699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:43219 every 8 connection(s)
I20260808 23:38:08.457818 13566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:38:08.461942 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 13566
I20260808 23:38:08.462256 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:38:08.463131 27455 external_mini_cluster.cc:1428] Setting key 9216fa9cbbec88f738b4799f47c26041
Aug 08 23:38:08 dist-test-slave-1x4g krb5kdc[13452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232288, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:38:08.482205 13702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:08.460950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:32775 (local address 127.26.207.254:46383)
0808 23:38:08.461536 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:08.461542 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:08.462798 (+ 1256us) server_negotiation.cc:407] Connection header received
0808 23:38:08.465573 (+ 2775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:08.465578 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:08.465695 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:08.465832 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:08.467666 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:08.468910 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:08.470707 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:08.471428 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:08.471604 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:08.475946 (+ 4342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:08.475952 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:08.475955 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:08.475994 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:08.478754 (+ 2760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:08.479613 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:08.479621 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:08.479629 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:08.479761 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:08.480228 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:08.480234 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:08.480237 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:08.480527 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:08.480696 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:08.481524 (+ 828us) server_negotiation.cc:299] Negotiation successful
0808 23:38:08.481786 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":311,"threads_started":1}
I20260808 23:38:08.483348 13703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:08.461526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:46383 (local address 127.26.207.193:32775)
0808 23:38:08.462598 (+ 1072us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:08.462644 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:08.465124 (+ 2480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:08.466115 (+ 991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:08.466125 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:08.466779 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:08.467446 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:08.467469 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:08.469094 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:08.469098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:08.470518 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:08.470534 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:08.471715 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:08.471721 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:08.471980 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:08.472855 (+ 875us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:38:08.472895 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:08.475646 (+ 2751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:08.478943 (+ 3297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:08.478953 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:08.478973 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:08.479469 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:08.479886 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:08.479890 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:08.479894 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:08.480107 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:08.480665 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:08.480674 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:08.481126 (+ 452us) client_negotiation.cc:769] Sending connection context
0808 23:38:08.481446 (+ 320us) client_negotiation.cc:240] Negotiation successful
0808 23:38:08.482031 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"thread_start_us":393,"threads_started":1}
I20260808 23:38:08.485165 13700 heartbeater.cc:347] Connected to a master server at 127.26.207.254:46383
I20260808 23:38:08.485517 13700 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:08.486299 13700 heartbeater.cc:511] Master 127.26.207.254:46383 requested a full tablet report, sending...
I20260808 23:38:08.488931 13500 ts_manager.cc:194] Registered new tserver with Master: 290f828f277f43dea4bf2c51b90bac49 (127.26.207.193:43219)
I20260808 23:38:08.491228 13500 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:32775
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:38:08.541407 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:46383
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:08.926107 13706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:08.926429 13706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:08.926533 13706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:08.934131 13706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:08.934280 13706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:08.934402 13706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:38:08.944744 13706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:46383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:08.946156 13706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:08.947540 13706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:08.962281 13715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:08.962116 13711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:08.962157 13713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:08.963362 13706 server_base.cc:1034] running on GCE node
I20260808 23:38:08.964105 13706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:08.965305 13706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:08.966596 13706 hybrid_clock.cc:648] HybridClock initialized: now 1786232288966527 us; error 62 us; skew 500 ppm
I20260808 23:38:08.966998 13706 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:08 dist-test-slave-1x4g krb5kdc[13452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232288, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:08.970697 13706 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:38:08.972426 13706 webserver.cc:460] Webserver started at http://127.26.207.194:36339/ using document root <none> and password file <none>
I20260808 23:38:08.973294 13706 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:08.973419 13706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:08.973727 13706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:08.977176 13706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "268c613e61e14a769edd7167e09de4c6"
format_stamp: "Formatted at 2026-08-08 23:38:08 on dist-test-slave-1x4g"
server_key: "be9f1b43a27a317b01cdd19b0d6ed69f"
server_key_iv: "3b0b70c88ccd67ca56c616e6580d9250"
server_key_version: "encryptionkey@0"
I20260808 23:38:08.978161 13706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "268c613e61e14a769edd7167e09de4c6"
format_stamp: "Formatted at 2026-08-08 23:38:08 on dist-test-slave-1x4g"
server_key: "be9f1b43a27a317b01cdd19b0d6ed69f"
server_key_iv: "3b0b70c88ccd67ca56c616e6580d9250"
server_key_version: "encryptionkey@0"
I20260808 23:38:08.984529 13706 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 23:38:08.989037 13723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:08.991353 13706 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 23:38:08.991607 13706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "268c613e61e14a769edd7167e09de4c6"
format_stamp: "Formatted at 2026-08-08 23:38:08 on dist-test-slave-1x4g"
server_key: "be9f1b43a27a317b01cdd19b0d6ed69f"
server_key_iv: "3b0b70c88ccd67ca56c616e6580d9250"
server_key_version: "encryptionkey@0"
I20260808 23:38:08.991940 13706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:09.027638 13706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:09.032657 13706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:09.033058 13706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:09.034224 13706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:09.035729 13706 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:09.035810 13706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:09.035998 13706 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:09.036053 13706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:09.072289 13706 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:34885
I20260808 23:38:09.072352 13838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:34885 every 8 connection(s)
I20260808 23:38:09.073782 13706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:38:09.078910 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 13706
I20260808 23:38:09.079128 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:38:09.079715 27455 external_mini_cluster.cc:1428] Setting key 94b5316988501b512be7fbb12744fcb5
Aug 08 23:38:09 dist-test-slave-1x4g krb5kdc[13452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232288, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:38:09.098984 13841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:09.076650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:55687 (local address 127.26.207.254:46383)
0808 23:38:09.077184 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:09.077192 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:09.078347 (+ 1155us) server_negotiation.cc:407] Connection header received
0808 23:38:09.081120 (+ 2773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:09.081127 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:09.081206 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:09.081331 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:09.083521 (+ 2190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.084243 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.086854 (+ 2611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.087290 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.087392 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:09.091944 (+ 4552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:09.091956 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:09.091959 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:09.091997 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:09.094973 (+ 2976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:09.095941 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:09.095947 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:09.095949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:09.096151 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:09.096697 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:09.096703 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:09.096708 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:09.097133 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:09.097316 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:09.098228 (+ 912us) server_negotiation.cc:299] Negotiation successful
0808 23:38:09.098580 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":262,"threads_started":1}
I20260808 23:38:09.100145 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:09.077365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:46383 (local address 127.26.207.194:55687)
0808 23:38:09.078160 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:09.078214 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:09.080755 (+ 2541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:09.081583 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:09.081592 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:09.082418 (+ 826us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:09.083321 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:09.083352 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.084407 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.084416 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:09.086691 (+ 2275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:09.086712 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.087532 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.087541 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:09.087885 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:09.088704 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:38:09.088739 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:09.091661 (+ 2922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:09.095192 (+ 3531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:09.095204 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:09.095233 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:09.095768 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:09.096287 (+ 519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:09.096292 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:09.096296 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:09.096550 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:09.097318 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:09.097329 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:09.097772 (+ 443us) client_negotiation.cc:769] Sending connection context
0808 23:38:09.098121 (+ 349us) client_negotiation.cc:240] Negotiation successful
0808 23:38:09.098787 (+ 666us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":299,"threads_started":1}
I20260808 23:38:09.101954 13839 heartbeater.cc:347] Connected to a master server at 127.26.207.254:46383
I20260808 23:38:09.102355 13839 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:09.103240 13839 heartbeater.cc:511] Master 127.26.207.254:46383 requested a full tablet report, sending...
I20260808 23:38:09.104997 13500 ts_manager.cc:194] Registered new tserver with Master: 268c613e61e14a769edd7167e09de4c6 (127.26.207.194:34885)
I20260808 23:38:09.105895 13500 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:55687
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:38:09.157236 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:46383
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:35165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:38:09.494964 13700 heartbeater.cc:503] Master 127.26.207.254:46383 was elected leader, sending a full tablet report...
W20260808 23:38:09.533429 13845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:09.533751 13845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:09.533939 13845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:09.541680 13845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:09.541812 13845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:09.542047 13845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:38:09.553105 13845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:35165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:46383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:09.554553 13845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:09.555972 13845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:09.570434 13851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:09.570616 13854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:09.570531 13850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:09.571825 13845 server_base.cc:1034] running on GCE node
I20260808 23:38:09.572572 13845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:09.573784 13845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:09.575063 13845 hybrid_clock.cc:648] HybridClock initialized: now 1786232289574994 us; error 69 us; skew 500 ppm
I20260808 23:38:09.575444 13845 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:09 dist-test-slave-1x4g krb5kdc[13452](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232289, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:09.583680 13845 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:38:09.585464 13845 webserver.cc:460] Webserver started at http://127.26.207.195:36551/ using document root <none> and password file <none>
I20260808 23:38:09.586220 13845 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:09.586339 13845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:09.586656 13845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:09.589958 13845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "b3d970e4944f41238cd1611af448ccc4"
format_stamp: "Formatted at 2026-08-08 23:38:09 on dist-test-slave-1x4g"
server_key: "93c0273f5b1d876f9e26732044d354b5"
server_key_iv: "5186d93c8fadda4c68745096bfe922d2"
server_key_version: "encryptionkey@0"
I20260808 23:38:09.590752 13845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "b3d970e4944f41238cd1611af448ccc4"
format_stamp: "Formatted at 2026-08-08 23:38:09 on dist-test-slave-1x4g"
server_key: "93c0273f5b1d876f9e26732044d354b5"
server_key_iv: "5186d93c8fadda4c68745096bfe922d2"
server_key_version: "encryptionkey@0"
I20260808 23:38:09.596877 13845 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260808 23:38:09.601336 13861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:09.603134 13845 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260808 23:38:09.603375 13845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "b3d970e4944f41238cd1611af448ccc4"
format_stamp: "Formatted at 2026-08-08 23:38:09 on dist-test-slave-1x4g"
server_key: "93c0273f5b1d876f9e26732044d354b5"
server_key_iv: "5186d93c8fadda4c68745096bfe922d2"
server_key_version: "encryptionkey@0"
I20260808 23:38:09.603618 13845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:09.618561 13845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:09.623500 13845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:09.623855 13845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:09.625121 13845 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:09.626739 13845 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:09.626857 13845 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:09.627055 13845 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:09.627137 13845 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:09.664194 13845 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:41633
I20260808 23:38:09.664237 13981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:41633 every 8 connection(s)
I20260808 23:38:09.665733 13845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:38:09.674232 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 13845
I20260808 23:38:09.674463 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:38:09.675086 27455 external_mini_cluster.cc:1428] Setting key b9ea0d157137ad45b40c590a6ef97e9f
Aug 08 23:38:09 dist-test-slave-1x4g krb5kdc[13452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232289, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:38:09.690498 13984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:09.668836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:43339 (local address 127.26.207.254:46383)
0808 23:38:09.669323 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:09.669328 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:09.670622 (+ 1294us) server_negotiation.cc:407] Connection header received
0808 23:38:09.672708 (+ 2086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:09.672715 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:09.672846 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:09.672974 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:09.675352 (+ 2378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.676384 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.678910 (+ 2526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.679323 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.679433 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:09.683521 (+ 4088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:09.683528 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:09.683531 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:09.683613 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:09.686641 (+ 3028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:09.687673 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:09.687678 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:09.687680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:09.687830 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:09.688357 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:09.688362 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:09.688364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:09.688673 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:09.688887 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:09.689849 (+ 962us) server_negotiation.cc:299] Negotiation successful
0808 23:38:09.690165 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":230,"threads_started":1}
I20260808 23:38:09.691664 13985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:09.669512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:46383 (local address 127.26.207.195:43339)
0808 23:38:09.670409 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:09.670456 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:09.672340 (+ 1884us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:09.673283 (+ 943us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:09.673294 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:09.674116 (+ 822us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:09.675062 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:09.675113 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.676642 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.676649 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:09.678751 (+ 2102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:09.678768 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.679581 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.679587 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:09.679845 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:09.680569 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:38:09.680594 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:09.683235 (+ 2641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:09.686896 (+ 3661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:09.686905 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:09.686921 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:09.687482 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:09.687963 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:09.687970 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:09.687978 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:09.688209 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:09.688860 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:09.688869 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:09.689337 (+ 468us) client_negotiation.cc:769] Sending connection context
0808 23:38:09.689671 (+ 334us) client_negotiation.cc:240] Negotiation successful
0808 23:38:09.690313 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":335,"threads_started":1}
I20260808 23:38:09.693149 13982 heartbeater.cc:347] Connected to a master server at 127.26.207.254:46383
I20260808 23:38:09.693445 13982 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:09.694226 13982 heartbeater.cc:511] Master 127.26.207.254:46383 requested a full tablet report, sending...
I20260808 23:38:09.695847 13500 ts_manager.cc:194] Registered new tserver with Master: b3d970e4944f41238cd1611af448ccc4 (127.26.207.195:41633)
I20260808 23:38:09.696718 13500 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:43339
I20260808 23:38:09.704417 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:38:09.723928 13984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:09.709793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43212 (local address 127.26.207.254:46383)
0808 23:38:09.709984 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:09.709989 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:09.710528 (+ 539us) server_negotiation.cc:407] Connection header received
0808 23:38:09.710668 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:09.710672 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:09.710760 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:09.710855 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:09.712383 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.713295 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.714781 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.715214 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.715317 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:09.718016 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:09.718021 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:09.718025 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:09.718066 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:09.721006 (+ 2940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:09.721841 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:09.721846 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:09.721848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:09.722032 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:09.722475 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:09.722479 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:09.722481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:09.722847 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:09.723065 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:09.723467 (+ 402us) server_negotiation.cc:299] Negotiation successful
0808 23:38:09.723687 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 23:38:09.728823 13500 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43212:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:38:09.736114 13500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:38:09.779013 13997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:09.750865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:43219 (local address 127.0.0.1:44048)
0808 23:38:09.760432 (+ 9567us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:09.760485 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:09.760697 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:09.768278 (+ 7581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:09.768290 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:09.768342 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:09.769051 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:09.769071 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.771623 (+ 2552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.771629 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:09.774758 (+ 3129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:09.774784 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.777632 (+ 2848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.777643 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:09.778099 (+ 456us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:09.778181 (+ 82us) client_negotiation.cc:769] Sending connection context
0808 23:38:09.778318 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 23:38:09.778567 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9264,"mutex_wait_us":58,"thread_start_us":15415,"threads_started":1}
I20260808 23:38:09.779621 13996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:09.751004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44048 (local address 127.26.207.193:43219)
0808 23:38:09.767269 (+ 16265us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:09.767283 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:09.767331 (+ 48us) server_negotiation.cc:407] Connection header received
0808 23:38:09.767481 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:09.767494 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:09.767869 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:09.769377 (+ 1508us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:09.769742 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.771437 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.775102 (+ 3665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.777278 (+ 2176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.778736 (+ 1458us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:09.778938 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:09.779041 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 23:38:09.779259 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15994,"thread_start_us":15781,"threads_started":1}
I20260808 23:38:09.782727 13998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:09.753024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42994 (local address 127.26.207.194:34885)
0808 23:38:09.757433 (+ 4409us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:09.757448 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:09.768737 (+ 11289us) server_negotiation.cc:407] Connection header received
0808 23:38:09.769184 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:09.769196 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:09.769543 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:09.769766 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:09.771107 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.773331 (+ 2224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.778633 (+ 5302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.781177 (+ 2544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.781345 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:09.781517 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:09.782083 (+ 566us) server_negotiation.cc:299] Negotiation successful
0808 23:38:09.782395 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4124,"thread_start_us":4077,"threads_started":1}
I20260808 23:38:09.782742 13995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:09.752259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:34885 (local address 127.0.0.1:42994)
0808 23:38:09.768537 (+ 16278us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:09.768572 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:09.768916 (+ 344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:09.770172 (+ 1256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:09.770180 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:09.770220 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:09.770838 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:09.770855 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.775396 (+ 4541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.775405 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:09.778431 (+ 3026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:09.778446 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.781660 (+ 3214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.781667 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:09.781849 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:09.781882 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 23:38:09.781995 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 23:38:09.782180 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14221,"mutex_wait_us":76,"thread_start_us":7680,"threads_started":1}
I20260808 23:38:09.784060 13631 tablet_service.cc:1467] Processing CreateTablet for tablet c04459809df94a6da4356d81b2542b08 (DEFAULT_TABLE table=test-table [id=3c6c6e95d9df42efbcb82ca86282d82e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:09.785830 13631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c04459809df94a6da4356d81b2542b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:09.787281 14000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:09.764180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50016 (local address 127.26.207.195:41633)
0808 23:38:09.778995 (+ 14815us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:09.779007 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:09.779050 (+ 43us) server_negotiation.cc:407] Connection header received
0808 23:38:09.779165 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:09.779173 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:09.779494 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:09.779717 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:09.780416 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.782017 (+ 1601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.785039 (+ 3022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.786169 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.786393 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:09.786586 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:09.786780 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 23:38:09.786947 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14615,"thread_start_us":15655,"threads_started":1}
I20260808 23:38:09.787282 13999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:09.764078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:41633 (local address 127.0.0.1:50016)
0808 23:38:09.778250 (+ 14172us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:09.778273 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:09.778397 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:09.779874 (+ 1477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:09.779879 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:09.779911 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:09.780218 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:09.780226 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.782186 (+ 1960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.782190 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:09.784841 (+ 2651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:09.784867 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.786393 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.786400 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:09.786573 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:09.786610 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 23:38:09.786734 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 23:38:09.786886 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14022,"thread_start_us":13830,"threads_started":1}
I20260808 23:38:09.787006 13771 tablet_service.cc:1467] Processing CreateTablet for tablet c04459809df94a6da4356d81b2542b08 (DEFAULT_TABLE table=test-table [id=3c6c6e95d9df42efbcb82ca86282d82e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:09.789326 13771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c04459809df94a6da4356d81b2542b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:09.791227 13911 tablet_service.cc:1467] Processing CreateTablet for tablet c04459809df94a6da4356d81b2542b08 (DEFAULT_TABLE table=test-table [id=3c6c6e95d9df42efbcb82ca86282d82e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:09.792510 13911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c04459809df94a6da4356d81b2542b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:09.802472 14001 tablet_bootstrap.cc:492] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49: Bootstrap starting.
I20260808 23:38:09.805668 14002 tablet_bootstrap.cc:492] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6: Bootstrap starting.
I20260808 23:38:09.808013 14001 tablet_bootstrap.cc:654] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:09.810305 14002 tablet_bootstrap.cc:654] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:09.810983 14001 log.cc:824] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:09.811533 14002 log.cc:824] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:09.812731 14003 tablet_bootstrap.cc:492] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4: Bootstrap starting.
I20260808 23:38:09.815116 14001 tablet_bootstrap.cc:492] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49: No bootstrap required, opened a new log
I20260808 23:38:09.815299 14002 tablet_bootstrap.cc:492] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6: No bootstrap required, opened a new log
I20260808 23:38:09.815456 14001 ts_tablet_manager.cc:1397] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.009s
I20260808 23:38:09.815621 14002 ts_tablet_manager.cc:1397] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 23:38:09.817009 14003 tablet_bootstrap.cc:654] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:09.818495 14003 log.cc:824] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:09.824348 14003 tablet_bootstrap.cc:492] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4: No bootstrap required, opened a new log
I20260808 23:38:09.824352 14002 raft_consensus.cc:348] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290f828f277f43dea4bf2c51b90bac49" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43219 } } peers { permanent_uuid: "268c613e61e14a769edd7167e09de4c6" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34885 } } peers { permanent_uuid: "b3d970e4944f41238cd1611af448ccc4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 41633 } }
I20260808 23:38:09.824693 14003 ts_tablet_manager.cc:1397] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260808 23:38:09.824882 14002 raft_consensus.cc:374] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:09.825031 14002 raft_consensus.cc:729] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 268c613e61e14a769edd7167e09de4c6, State: Initialized, Role: FOLLOWER
I20260808 23:38:09.825752 14002 consensus_queue.cc:260] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290f828f277f43dea4bf2c51b90bac49" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43219 } } peers { permanent_uuid: "268c613e61e14a769edd7167e09de4c6" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34885 } } peers { permanent_uuid: "b3d970e4944f41238cd1611af448ccc4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 41633 } }
I20260808 23:38:09.827077 13839 heartbeater.cc:503] Master 127.26.207.254:46383 was elected leader, sending a full tablet report...
I20260808 23:38:09.827766 14001 raft_consensus.cc:348] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290f828f277f43dea4bf2c51b90bac49" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43219 } } peers { permanent_uuid: "268c613e61e14a769edd7167e09de4c6" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34885 } } peers { permanent_uuid: "b3d970e4944f41238cd1611af448ccc4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 41633 } }
I20260808 23:38:09.828276 14001 raft_consensus.cc:374] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:09.828372 14001 raft_consensus.cc:729] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 290f828f277f43dea4bf2c51b90bac49, State: Initialized, Role: FOLLOWER
I20260808 23:38:09.828563 14002 ts_tablet_manager.cc:1428] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6: Time spent starting tablet: real 0.013s user 0.008s sys 0.005s
I20260808 23:38:09.829533 14001 consensus_queue.cc:260] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290f828f277f43dea4bf2c51b90bac49" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43219 } } peers { permanent_uuid: "268c613e61e14a769edd7167e09de4c6" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34885 } } peers { permanent_uuid: "b3d970e4944f41238cd1611af448ccc4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 41633 } }
I20260808 23:38:09.833523 14001 ts_tablet_manager.cc:1428] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49: Time spent starting tablet: real 0.018s user 0.018s sys 0.000s
I20260808 23:38:09.836766 14003 raft_consensus.cc:348] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290f828f277f43dea4bf2c51b90bac49" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43219 } } peers { permanent_uuid: "268c613e61e14a769edd7167e09de4c6" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34885 } } peers { permanent_uuid: "b3d970e4944f41238cd1611af448ccc4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 41633 } }
I20260808 23:38:09.837395 14003 raft_consensus.cc:374] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:09.837534 14003 raft_consensus.cc:729] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d970e4944f41238cd1611af448ccc4, State: Initialized, Role: FOLLOWER
I20260808 23:38:09.838233 14003 consensus_queue.cc:260] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290f828f277f43dea4bf2c51b90bac49" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43219 } } peers { permanent_uuid: "268c613e61e14a769edd7167e09de4c6" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34885 } } peers { permanent_uuid: "b3d970e4944f41238cd1611af448ccc4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 41633 } }
I20260808 23:38:09.839587 13982 heartbeater.cc:503] Master 127.26.207.254:46383 was elected leader, sending a full tablet report...
I20260808 23:38:09.840343 14003 ts_tablet_manager.cc:1428] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4: Time spent starting tablet: real 0.016s user 0.013s sys 0.001s
W20260808 23:38:09.917999 13983 tablet.cc:2369] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:38:09.950781 14009 raft_consensus.cc:482] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:38:09.951182 14009 raft_consensus.cc:504] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290f828f277f43dea4bf2c51b90bac49" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43219 } } peers { permanent_uuid: "268c613e61e14a769edd7167e09de4c6" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34885 } } peers { permanent_uuid: "b3d970e4944f41238cd1611af448ccc4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 41633 } }
I20260808 23:38:09.953367 14009 leader_election.cc:288] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 268c613e61e14a769edd7167e09de4c6 (127.26.207.194:34885), b3d970e4944f41238cd1611af448ccc4 (127.26.207.195:41633)
I20260808 23:38:09.960534 13998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:09.953753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:60361 (local address 127.26.207.194:34885)
0808 23:38:09.953957 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:09.953963 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:09.954493 (+ 530us) server_negotiation.cc:407] Connection header received
0808 23:38:09.954730 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:09.954735 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:09.954821 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:09.954931 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:09.955553 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.956306 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.958426 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.959476 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.959683 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:09.959768 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:09.960094 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 23:38:09.960235 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 23:38:09.960696 14011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:09.953633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:34885 (local address 127.26.207.193:60361)
0808 23:38:09.954376 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:09.954396 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:09.954553 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:09.954997 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:09.955001 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:09.955034 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:09.955384 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:09.955394 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.956449 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.956456 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:09.958221 (+ 1765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:09.958235 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.959713 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.959720 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:09.959909 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:09.959935 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 23:38:09.960065 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 23:38:09.960217 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":383,"threads_started":1}
I20260808 23:38:09.960819 14012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:09.954511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:41633 (local address 127.26.207.193:41549)
0808 23:38:09.955194 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:09.955208 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:09.955374 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:09.955704 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:09.955708 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:09.955731 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:09.956091 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:09.956100 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.957223 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.957229 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:09.958664 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:09.958677 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.959916 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.959931 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:09.960100 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:09.960125 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 23:38:09.960238 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 23:38:09.960381 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":341,"threads_started":1}
I20260808 23:38:09.961046 14000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:09.954678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:41549 (local address 127.26.207.195:41633)
0808 23:38:09.954878 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:09.954886 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:09.955308 (+ 422us) server_negotiation.cc:407] Connection header received
0808 23:38:09.955524 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:09.955528 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:09.955586 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:09.955684 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:09.956248 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.957078 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.958845 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:09.959663 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:09.959869 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:09.959950 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:09.960267 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 23:38:09.960402 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260808 23:38:09.961330 13701 tablet.cc:2369] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:38:09.962052 13793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c04459809df94a6da4356d81b2542b08" candidate_uuid: "290f828f277f43dea4bf2c51b90bac49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "268c613e61e14a769edd7167e09de4c6" is_pre_election: true
I20260808 23:38:09.962064 13934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c04459809df94a6da4356d81b2542b08" candidate_uuid: "290f828f277f43dea4bf2c51b90bac49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d970e4944f41238cd1611af448ccc4" is_pre_election: true
I20260808 23:38:09.962630 13934 raft_consensus.cc:2454] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 290f828f277f43dea4bf2c51b90bac49 in term 0.
I20260808 23:38:09.962634 13793 raft_consensus.cc:2454] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 290f828f277f43dea4bf2c51b90bac49 in term 0.
I20260808 23:38:09.963521 13585 leader_election.cc:302] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 290f828f277f43dea4bf2c51b90bac49, b3d970e4944f41238cd1611af448ccc4; no voters:
I20260808 23:38:09.964123 14009 raft_consensus.cc:2781] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:38:09.964296 14009 raft_consensus.cc:482] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:38:09.964485 14009 raft_consensus.cc:3037] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:09.966936 14009 raft_consensus.cc:504] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290f828f277f43dea4bf2c51b90bac49" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43219 } } peers { permanent_uuid: "268c613e61e14a769edd7167e09de4c6" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34885 } } peers { permanent_uuid: "b3d970e4944f41238cd1611af448ccc4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 41633 } }
I20260808 23:38:09.967741 14009 leader_election.cc:288] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [CANDIDATE]: Term 1 election: Requested vote from peers 268c613e61e14a769edd7167e09de4c6 (127.26.207.194:34885), b3d970e4944f41238cd1611af448ccc4 (127.26.207.195:41633)
I20260808 23:38:09.968364 13793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c04459809df94a6da4356d81b2542b08" candidate_uuid: "290f828f277f43dea4bf2c51b90bac49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "268c613e61e14a769edd7167e09de4c6"
I20260808 23:38:09.968405 13934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c04459809df94a6da4356d81b2542b08" candidate_uuid: "290f828f277f43dea4bf2c51b90bac49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d970e4944f41238cd1611af448ccc4"
I20260808 23:38:09.968605 13793 raft_consensus.cc:3037] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:09.968676 13934 raft_consensus.cc:3037] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:09.971138 13793 raft_consensus.cc:2454] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290f828f277f43dea4bf2c51b90bac49 in term 1.
I20260808 23:38:09.971134 13934 raft_consensus.cc:2454] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290f828f277f43dea4bf2c51b90bac49 in term 1.
I20260808 23:38:09.971709 13585 leader_election.cc:302] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 290f828f277f43dea4bf2c51b90bac49, b3d970e4944f41238cd1611af448ccc4; no voters:
I20260808 23:38:09.972407 14009 raft_consensus.cc:2781] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:09.973102 14009 raft_consensus.cc:686] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [term 1 LEADER]: Becoming Leader. State: Replica: 290f828f277f43dea4bf2c51b90bac49, State: Running, Role: LEADER
I20260808 23:38:09.974049 14009 consensus_queue.cc:237] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290f828f277f43dea4bf2c51b90bac49" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43219 } } peers { permanent_uuid: "268c613e61e14a769edd7167e09de4c6" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34885 } } peers { permanent_uuid: "b3d970e4944f41238cd1611af448ccc4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 41633 } }
I20260808 23:38:09.978981 13500 catalog_manager.cc:5495] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 290f828f277f43dea4bf2c51b90bac49 (127.26.207.193). New cstate: current_term: 1 leader_uuid: "290f828f277f43dea4bf2c51b90bac49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290f828f277f43dea4bf2c51b90bac49" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 43219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "268c613e61e14a769edd7167e09de4c6" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d970e4944f41238cd1611af448ccc4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 41633 } health_report { overall_health: UNKNOWN } } }
I20260808 23:38:10.013790 13996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:10.007770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44062 (local address 127.26.207.193:43219)
0808 23:38:10.007974 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:10.007979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:10.007999 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:38:10.008149 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:10.008153 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:10.008269 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:10.008413 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:38:10.008939 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:10.009666 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:10.011231 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:10.011671 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:10.011815 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:10.012393 (+ 578us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:38:10.013120 (+ 727us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:38:10.013279 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:10.013394 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 23:38:10.013473 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 23:38:10.022848 13793 raft_consensus.cc:1261] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6 [term 1 FOLLOWER]: Refusing update from remote peer 290f828f277f43dea4bf2c51b90bac49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:38:10.022831 13934 raft_consensus.cc:1261] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4 [term 1 FOLLOWER]: Refusing update from remote peer 290f828f277f43dea4bf2c51b90bac49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:38:10.023864 14013 consensus_queue.cc:1035] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "268c613e61e14a769edd7167e09de4c6" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:38:10.024276 14009 consensus_queue.cc:1035] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d970e4944f41238cd1611af448ccc4" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:38:10.052093 13500 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:38:10.052413 13500 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:38:10.056452 13500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5f12e7604b1947e9b08278e1998f4a65: Sending DeleteTablet for 3 replicas of tablet c04459809df94a6da4356d81b2542b08
I20260808 23:38:10.058075 13771 tablet_service.cc:1514] Processing DeleteTablet for tablet c04459809df94a6da4356d81b2542b08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:10 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:42994
I20260808 23:38:10.058084 13631 tablet_service.cc:1514] Processing DeleteTablet for tablet c04459809df94a6da4356d81b2542b08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:10 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:44048
I20260808 23:38:10.058243 13911 tablet_service.cc:1514] Processing DeleteTablet for tablet c04459809df94a6da4356d81b2542b08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:10 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:50016
I20260808 23:38:10.060319 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 13566
I20260808 23:38:10.069555 14028 tablet_replica.cc:330] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4: stopping tablet replica
I20260808 23:38:10.069746 14027 tablet_replica.cc:330] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6: stopping tablet replica
I20260808 23:38:10.070317 14027 raft_consensus.cc:2229] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:38:10.070557 14028 raft_consensus.cc:2229] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:38:10.070916 14027 raft_consensus.cc:2258] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:10.071316 14028 raft_consensus.cc:2258] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:10.071916 14026 tablet_replica.cc:330] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49: stopping tablet replica
I20260808 23:38:10.072389 14026 raft_consensus.cc:2229] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:38:10.073197 14026 raft_consensus.cc:2258] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:10.074313 14028 ts_tablet_manager.cc:1905] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:10.075397 14026 ts_tablet_manager.cc:1905] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:10.081921 14028 ts_tablet_manager.cc:1918] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:10.082252 14028 log.cc:1196] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/c04459809df94a6da4356d81b2542b08
I20260808 23:38:10.083019 14028 ts_tablet_manager.cc:1939] T c04459809df94a6da4356d81b2542b08 P b3d970e4944f41238cd1611af448ccc4: Deleting consensus metadata
I20260808 23:38:10.083870 14026 ts_tablet_manager.cc:1918] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:10.084165 14026 log.cc:1196] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/c04459809df94a6da4356d81b2542b08
I20260808 23:38:10.084435 14027 ts_tablet_manager.cc:1905] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:10.084892 14026 ts_tablet_manager.cc:1939] T c04459809df94a6da4356d81b2542b08 P 290f828f277f43dea4bf2c51b90bac49: Deleting consensus metadata
I20260808 23:38:10.085494 13485 catalog_manager.cc:4841] TS b3d970e4944f41238cd1611af448ccc4 (127.26.207.195:41633): tablet c04459809df94a6da4356d81b2542b08 (table test-table [id=3c6c6e95d9df42efbcb82ca86282d82e]) successfully deleted
I20260808 23:38:10.086863 13484 catalog_manager.cc:4841] TS 290f828f277f43dea4bf2c51b90bac49 (127.26.207.193:43219): tablet c04459809df94a6da4356d81b2542b08 (table test-table [id=3c6c6e95d9df42efbcb82ca86282d82e]) successfully deleted
I20260808 23:38:10.093580 14027 ts_tablet_manager.cc:1918] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:10.093962 14027 log.cc:1196] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/c04459809df94a6da4356d81b2542b08
I20260808 23:38:10.094746 14027 ts_tablet_manager.cc:1939] T c04459809df94a6da4356d81b2542b08 P 268c613e61e14a769edd7167e09de4c6: Deleting consensus metadata
Aug 08 23:38:10 dist-test-slave-1x4g krb5kdc[13452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:38:10.097338 13485 catalog_manager.cc:4841] TS 268c613e61e14a769edd7167e09de4c6 (127.26.207.194:34885): tablet c04459809df94a6da4356d81b2542b08 (table test-table [id=3c6c6e95d9df42efbcb82ca86282d82e]) successfully deleted
I20260808 23:38:10.106594 13996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:10.063841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44064 (local address 127.26.207.193:43219)
0808 23:38:10.064070 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:10.064078 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:10.068698 (+ 4620us) server_negotiation.cc:407] Connection header received
0808 23:38:10.070160 (+ 1462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:10.070167 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:10.070292 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:10.070389 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:10.087350 (+ 16961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:10.088597 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:10.090689 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:10.091504 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:10.091624 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:10.098494 (+ 6870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:10.098512 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:10.098527 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:10.098622 (+ 95us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:10.102703 (+ 4081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:10.103670 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:10.103678 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:10.103681 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:10.103908 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:10.104356 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:10.104373 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:10.104377 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:10.105027 (+ 650us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:10.105397 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:10.105921 (+ 524us) server_negotiation.cc:299] Negotiation successful
0808 23:38:10.106202 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 23:38:10.107417 13695 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:10.212571 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 13566
I20260808 23:38:10.237105 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 13706
Aug 08 23:38:10 dist-test-slave-1x4g krb5kdc[13452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:38:10.254729 13998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:10.238143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42998 (local address 127.26.207.194:34885)
0808 23:38:10.238326 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:10.238330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:10.238350 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:38:10.238413 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:10.238416 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:10.238503 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:10.238604 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:10.240057 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:10.240983 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:10.242508 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:10.242937 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:10.243062 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:10.248032 (+ 4970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:10.248052 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:10.248070 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:10.248118 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:10.251190 (+ 3072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:10.252097 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:10.252106 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:10.252109 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:10.252259 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:10.252690 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:10.252695 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:10.252697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:10.253585 (+ 888us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:10.253895 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:10.254215 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 23:38:10.254427 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 23:38:10.255589 13834 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:10.352533 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 13706
I20260808 23:38:10.375276 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 13845
Aug 08 23:38:10 dist-test-slave-1x4g krb5kdc[13452](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:38:10.392326 14000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:10.376108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50022 (local address 127.26.207.195:41633)
0808 23:38:10.376304 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:10.376313 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:10.376335 (+ 22us) server_negotiation.cc:407] Connection header received
0808 23:38:10.376557 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:10.376569 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:10.376660 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:10.376775 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:10.378232 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:10.378975 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:10.380388 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:10.380864 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:10.381003 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:10.386249 (+ 5246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:10.386269 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:10.386285 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:10.386330 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:10.389404 (+ 3074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:10.390279 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:10.390288 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:10.390290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:10.390463 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:10.390836 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:10.390839 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:10.390841 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:10.391219 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:10.391465 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:10.391731 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 23:38:10.391914 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 23:38:10.393118 13977 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:10.486259 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 13845
I20260808 23:38:10.508845 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 13466
I20260808 23:38:10.510190 13533 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:10.627056 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 13466
2026-08-08T23:38:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4961 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T23:38:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:10Z Disabled control of system clock
I20260808 23:38:10.741927 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:42071
--webserver_interface=127.26.207.254
--webserver_port=0
--builtin_ntp_servers=127.26.207.212:44783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:42071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 23:38:11.128648 14037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:11.129067 14037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:11.129174 14037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:11.136890 14037 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:11.137063 14037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:11.137120 14037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:11.137187 14037 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:11.137233 14037 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:11.147317 14037 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:42071
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:42071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:11.148723 14037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:11.150746 14037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:11.164240 14042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:11.164283 14046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:11.164307 14044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:11.165212 14037 server_base.cc:1034] running on GCE node
I20260808 23:38:11.166172 14037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:11.167900 14037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:11.169227 14037 hybrid_clock.cc:648] HybridClock initialized: now 1786232291169151 us; error 70 us; skew 500 ppm
I20260808 23:38:11.169865 14037 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:38:11.174096 14037 webserver.cc:460] Webserver started at http://127.26.207.254:39757/ using document root <none> and password file <none>
I20260808 23:38:11.175253 14037 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:11.175437 14037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:11.175845 14037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:11.179823 14037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "7b8fa0c3d47c4239a3f661422b86608d"
format_stamp: "Formatted at 2026-08-08 23:38:11 on dist-test-slave-1x4g"
server_key: "9ace22dba47a6b968cef1ecb858e4386"
server_key_iv: "bf4ac1ede4dfa6da21991136a54a809a"
server_key_version: "encryptionkey@0"
I20260808 23:38:11.180827 14037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "7b8fa0c3d47c4239a3f661422b86608d"
format_stamp: "Formatted at 2026-08-08 23:38:11 on dist-test-slave-1x4g"
server_key: "9ace22dba47a6b968cef1ecb858e4386"
server_key_iv: "bf4ac1ede4dfa6da21991136a54a809a"
server_key_version: "encryptionkey@0"
I20260808 23:38:11.186823 14037 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260808 23:38:11.190915 14052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:11.192508 14037 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 23:38:11.192765 14037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "7b8fa0c3d47c4239a3f661422b86608d"
format_stamp: "Formatted at 2026-08-08 23:38:11 on dist-test-slave-1x4g"
server_key: "9ace22dba47a6b968cef1ecb858e4386"
server_key_iv: "bf4ac1ede4dfa6da21991136a54a809a"
server_key_version: "encryptionkey@0"
I20260808 23:38:11.193085 14037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:11.218814 14037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:11.219851 14037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:11.220199 14037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:11.241250 14037 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:42071
I20260808 23:38:11.241269 14108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:42071 every 8 connection(s)
I20260808 23:38:11.242786 14037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:11.247038 14109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:11.249543 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 14037
I20260808 23:38:11.249781 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:11.250279 27455 external_mini_cluster.cc:1428] Setting key b0e408f18e5041bca6c534e1afa469ac
I20260808 23:38:11.260221 14109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d: Bootstrap starting.
I20260808 23:38:11.263792 14109 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:11.265198 14109 log.cc:824] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:11.265900 14112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:11.252603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48690 (local address 127.26.207.254:42071)
0808 23:38:11.253857 (+ 1254us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:11.253880 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:11.253930 (+ 50us) server_negotiation.cc:407] Connection header received
0808 23:38:11.256075 (+ 2145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:11.256127 (+ 52us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:11.256917 (+ 790us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:11.257385 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:11.258059 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:11.259397 (+ 1338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:11.260945 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:11.261665 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:11.261889 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:11.263155 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:11.263163 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:11.263179 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:11.263742 (+ 563us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:11.263855 (+ 113us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:11.263877 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:11.264022 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:11.264284 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 23:38:11.264670 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":755,"thread_start_us":439,"threads_started":1}
I20260808 23:38:11.268580 14109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d: No bootstrap required, opened a new log
I20260808 23:38:11.276364 14109 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b8fa0c3d47c4239a3f661422b86608d" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 42071 } }
I20260808 23:38:11.276906 14109 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:11.277041 14109 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8fa0c3d47c4239a3f661422b86608d, State: Initialized, Role: FOLLOWER
I20260808 23:38:11.277697 14109 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b8fa0c3d47c4239a3f661422b86608d" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 42071 } }
I20260808 23:38:11.277982 14109 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:11.278146 14109 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:11.278337 14109 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:11.281177 14109 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b8fa0c3d47c4239a3f661422b86608d" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 42071 } }
I20260808 23:38:11.281775 14109 leader_election.cc:302] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b8fa0c3d47c4239a3f661422b86608d; no voters:
I20260808 23:38:11.282449 14109 leader_election.cc:288] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:11.282644 14114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:11.283493 14114 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [term 1 LEADER]: Becoming Leader. State: Replica: 7b8fa0c3d47c4239a3f661422b86608d, State: Running, Role: LEADER
I20260808 23:38:11.284070 14114 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b8fa0c3d47c4239a3f661422b86608d" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 42071 } }
I20260808 23:38:11.284804 14109 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:11.287379 14115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b8fa0c3d47c4239a3f661422b86608d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b8fa0c3d47c4239a3f661422b86608d" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 42071 } } }
I20260808 23:38:11.287388 14116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b8fa0c3d47c4239a3f661422b86608d. Latest consensus state: current_term: 1 leader_uuid: "7b8fa0c3d47c4239a3f661422b86608d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b8fa0c3d47c4239a3f661422b86608d" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 42071 } } }
I20260808 23:38:11.288113 14116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:11.288265 14115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:11.289808 14122 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:11.296093 14122 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:11.307052 14122 catalog_manager.cc:1347] Generated new cluster ID: f4701170148740f3a43fad06247f38fe
I20260808 23:38:11.307196 14122 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:11.329416 14122 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:11.330859 14122 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:11.342092 14122 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d: Generated new TSK 0
I20260808 23:38:11.343055 14122 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:38:11.359025 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:42071
--builtin_ntp_servers=127.26.207.212:44783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 23:38:11.759298 14133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:11.759694 14133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:11.759797 14133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:11.767537 14133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:11.767650 14133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:11.767762 14133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:38:11.777837 14133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:42071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:11.779206 14133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:11.781268 14133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:11.795785 14142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:11.795921 14140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:11.795938 14139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:11.796922 14133 server_base.cc:1034] running on GCE node
I20260808 23:38:11.797746 14133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:11.798933 14133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:11.800215 14133 hybrid_clock.cc:648] HybridClock initialized: now 1786232291800141 us; error 79 us; skew 500 ppm
I20260808 23:38:11.800629 14133 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:38:11.803375 14133 webserver.cc:460] Webserver started at http://127.26.207.193:46537/ using document root <none> and password file <none>
I20260808 23:38:11.804237 14133 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:11.804406 14133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:11.805078 14133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:11.808529 14133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "1821562392b54125bb70f3fad3263f76"
format_stamp: "Formatted at 2026-08-08 23:38:11 on dist-test-slave-1x4g"
server_key: "ea80a8e69ed777579088b14124a02460"
server_key_iv: "5249049c87e211e43d0d99048482a1d4"
server_key_version: "encryptionkey@0"
I20260808 23:38:11.809695 14133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "1821562392b54125bb70f3fad3263f76"
format_stamp: "Formatted at 2026-08-08 23:38:11 on dist-test-slave-1x4g"
server_key: "ea80a8e69ed777579088b14124a02460"
server_key_iv: "5249049c87e211e43d0d99048482a1d4"
server_key_version: "encryptionkey@0"
I20260808 23:38:11.816110 14133 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 23:38:11.820442 14149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:11.822238 14133 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260808 23:38:11.822489 14133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "1821562392b54125bb70f3fad3263f76"
format_stamp: "Formatted at 2026-08-08 23:38:11 on dist-test-slave-1x4g"
server_key: "ea80a8e69ed777579088b14124a02460"
server_key_iv: "5249049c87e211e43d0d99048482a1d4"
server_key_version: "encryptionkey@0"
I20260808 23:38:11.822759 14133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:11.856575 14133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:11.857657 14133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:11.857968 14133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:11.859000 14133 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:11.860612 14133 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:11.860708 14133 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:11.860845 14133 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:11.860931 14133 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 23:38:11.896025 14133 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:42443
I20260808 23:38:11.896091 14268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:42443 every 8 connection(s)
I20260808 23:38:11.897765 14133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:38:11.902733 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 14133
I20260808 23:38:11.902949 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:38:11.903429 27455 external_mini_cluster.cc:1428] Setting key c0aa82ccb4fd5d7dbaa29b6b0e8a0e4a
I20260808 23:38:11.906865 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:42071
--builtin_ntp_servers=127.26.207.212:44783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 23:38:11.913173 14273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:11.900949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:59493 (local address 127.26.207.254:42071)
0808 23:38:11.901482 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:11.901487 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:11.902861 (+ 1374us) server_negotiation.cc:407] Connection header received
0808 23:38:11.905473 (+ 2612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:11.905479 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:11.905577 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:11.905674 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:11.907101 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:11.907861 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:11.909917 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:11.910355 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:11.910515 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:11.912162 (+ 1647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:11.912167 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:11.912170 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:11.912193 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:11.912238 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:11.912251 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:11.912361 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:11.912639 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 23:38:11.912759 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":300,"threads_started":1}
I20260808 23:38:11.914357 14274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:11.901570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:42071 (local address 127.26.207.193:59493)
0808 23:38:11.902651 (+ 1081us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:11.902701 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:11.905031 (+ 2330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:11.906060 (+ 1029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:11.906076 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:11.906201 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:11.906876 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:11.906897 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:11.908076 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:11.908081 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:11.909718 (+ 1637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:11.909736 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:11.910639 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:11.910648 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:11.910918 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:11.911756 (+ 838us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:38:11.911758 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:11.911807 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:38:11.911900 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:11.912363 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:11.912380 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:11.912391 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 23:38:11.912610 (+ 219us) client_negotiation.cc:240] Negotiation successful
0808 23:38:11.913123 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":312,"threads_started":1}
I20260808 23:38:11.916245 14269 heartbeater.cc:347] Connected to a master server at 127.26.207.254:42071
I20260808 23:38:11.916646 14269 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:11.917771 14269 heartbeater.cc:511] Master 127.26.207.254:42071 requested a full tablet report, sending...
I20260808 23:38:11.920549 14071 ts_manager.cc:194] Registered new tserver with Master: 1821562392b54125bb70f3fad3263f76 (127.26.207.193:42443)
I20260808 23:38:11.922245 14071 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.207.193:59493
W20260808 23:38:12.281716 14275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:12.282125 14275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:12.282301 14275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:12.290206 14275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:12.290367 14275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:12.290589 14275 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:38:12.301352 14275 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:42071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:12.303028 14275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:12.305157 14275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:12.321306 14281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:12.321285 14282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:12.322053 14284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:12.322929 14275 server_base.cc:1034] running on GCE node
I20260808 23:38:12.323791 14275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:12.325111 14275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:12.326426 14275 hybrid_clock.cc:648] HybridClock initialized: now 1786232292326379 us; error 60 us; skew 500 ppm
I20260808 23:38:12.326889 14275 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:38:12.329942 14275 webserver.cc:460] Webserver started at http://127.26.207.194:36935/ using document root <none> and password file <none>
I20260808 23:38:12.330812 14275 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:12.330945 14275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:12.331269 14275 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:12.334837 14275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "d3bf4534d40b4bccaac16dbb76af35af"
format_stamp: "Formatted at 2026-08-08 23:38:12 on dist-test-slave-1x4g"
server_key: "561a6df8012f8843a1add0e06faedb33"
server_key_iv: "86c926460ef14952a6fc5cffaba801cc"
server_key_version: "encryptionkey@0"
I20260808 23:38:12.335824 14275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "d3bf4534d40b4bccaac16dbb76af35af"
format_stamp: "Formatted at 2026-08-08 23:38:12 on dist-test-slave-1x4g"
server_key: "561a6df8012f8843a1add0e06faedb33"
server_key_iv: "86c926460ef14952a6fc5cffaba801cc"
server_key_version: "encryptionkey@0"
I20260808 23:38:12.342372 14275 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 23:38:12.347159 14291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:12.348929 14275 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:38:12.349180 14275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "d3bf4534d40b4bccaac16dbb76af35af"
format_stamp: "Formatted at 2026-08-08 23:38:12 on dist-test-slave-1x4g"
server_key: "561a6df8012f8843a1add0e06faedb33"
server_key_iv: "86c926460ef14952a6fc5cffaba801cc"
server_key_version: "encryptionkey@0"
I20260808 23:38:12.349505 14275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:12.363003 14275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:12.364044 14275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:12.364450 14275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:12.365723 14275 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:12.367589 14275 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:12.367746 14275 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:12.367914 14275 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:12.368021 14275 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:12.408630 14275 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:45119
I20260808 23:38:12.408685 14411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:45119 every 8 connection(s)
I20260808 23:38:12.410233 14275 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:38:12.415966 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 14275
I20260808 23:38:12.416193 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:38:12.416873 27455 external_mini_cluster.cc:1428] Setting key 7c3047d22b05a2698b87faca4584f119
I20260808 23:38:12.421211 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:42071
--builtin_ntp_servers=127.26.207.212:44783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 23:38:12.429100 14414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:12.413752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:37261 (local address 127.26.207.254:42071)
0808 23:38:12.414432 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:12.414436 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:12.415825 (+ 1389us) server_negotiation.cc:407] Connection header received
0808 23:38:12.418869 (+ 3044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:12.418874 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:12.418947 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:12.419080 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:12.420870 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:12.421780 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:12.424926 (+ 3146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:12.425477 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:12.425628 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:12.428007 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:12.428016 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:12.428020 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:12.428057 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:12.428113 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:12.428131 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:12.428256 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:12.428601 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 23:38:12.428711 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":446,"threads_started":1}
I20260808 23:38:12.430943 14415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:12.414407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:42071 (local address 127.26.207.194:37261)
0808 23:38:12.415584 (+ 1177us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:12.415657 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:12.418479 (+ 2822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:12.419443 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:12.419457 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:12.419597 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:12.420553 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:12.420587 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:12.422007 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:12.422017 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:12.424567 (+ 2550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:12.424597 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:12.425812 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:12.425865 (+ 53us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:12.426290 (+ 425us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:12.427399 (+ 1109us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:38:12.427405 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:12.427504 (+ 99us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:38:12.427648 (+ 144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:12.428303 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:12.428319 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:12.428331 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 23:38:12.428596 (+ 265us) client_negotiation.cc:240] Negotiation successful
0808 23:38:12.429200 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":321,"threads_started":1}
I20260808 23:38:12.432883 14412 heartbeater.cc:347] Connected to a master server at 127.26.207.254:42071
I20260808 23:38:12.433311 14412 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:12.434496 14412 heartbeater.cc:511] Master 127.26.207.254:42071 requested a full tablet report, sending...
I20260808 23:38:12.436666 14071 ts_manager.cc:194] Registered new tserver with Master: d3bf4534d40b4bccaac16dbb76af35af (127.26.207.194:45119)
I20260808 23:38:12.437649 14071 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.207.194:37261
W20260808 23:38:12.794776 14416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:12.795104 14416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:12.795280 14416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:12.803158 14416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:12.803288 14416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:12.803479 14416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:38:12.813496 14416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:42071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:12.814950 14416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:12.816963 14416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:12.833211 14422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:12.833245 14423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:12.834360 14425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:12.835631 14416 server_base.cc:1034] running on GCE node
I20260808 23:38:12.836330 14416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:12.837481 14416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:12.838703 14416 hybrid_clock.cc:648] HybridClock initialized: now 1786232292838642 us; error 47 us; skew 500 ppm
I20260808 23:38:12.839042 14416 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:38:12.841727 14416 webserver.cc:460] Webserver started at http://127.26.207.195:42927/ using document root <none> and password file <none>
I20260808 23:38:12.842461 14416 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:12.842556 14416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:12.842829 14416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:12.846035 14416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "c9afb1d6a4954a6d91038bad2ec9ba09"
format_stamp: "Formatted at 2026-08-08 23:38:12 on dist-test-slave-1x4g"
server_key: "e604256a5e1c972785127aaefd483ffd"
server_key_iv: "480e713322a7ec686a4acd2287d448f0"
server_key_version: "encryptionkey@0"
I20260808 23:38:12.846889 14416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "c9afb1d6a4954a6d91038bad2ec9ba09"
format_stamp: "Formatted at 2026-08-08 23:38:12 on dist-test-slave-1x4g"
server_key: "e604256a5e1c972785127aaefd483ffd"
server_key_iv: "480e713322a7ec686a4acd2287d448f0"
server_key_version: "encryptionkey@0"
I20260808 23:38:12.852717 14416 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260808 23:38:12.857059 14431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:12.858714 14416 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 23:38:12.858934 14416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "c9afb1d6a4954a6d91038bad2ec9ba09"
format_stamp: "Formatted at 2026-08-08 23:38:12 on dist-test-slave-1x4g"
server_key: "e604256a5e1c972785127aaefd483ffd"
server_key_iv: "480e713322a7ec686a4acd2287d448f0"
server_key_version: "encryptionkey@0"
I20260808 23:38:12.859196 14416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:12.887398 14416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:12.888363 14416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:12.888720 14416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:12.889856 14416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:12.891660 14416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:12.891804 14416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:12.891952 14416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:12.892048 14416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:12.926023 14269 heartbeater.cc:503] Master 127.26.207.254:42071 was elected leader, sending a full tablet report...
I20260808 23:38:12.930751 14416 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:40749
I20260808 23:38:12.930809 14551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:40749 every 8 connection(s)
I20260808 23:38:12.932240 14416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:38:12.940625 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 14416
I20260808 23:38:12.940863 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:38:12.941370 27455 external_mini_cluster.cc:1428] Setting key cc2e0f407436bd0daf385084d76215d7
I20260808 23:38:12.946666 14554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:12.935059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:46845 (local address 127.26.207.254:42071)
0808 23:38:12.935604 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:12.935609 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:12.937095 (+ 1486us) server_negotiation.cc:407] Connection header received
0808 23:38:12.939063 (+ 1968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:12.939069 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:12.939167 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:12.939293 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:12.940505 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:12.941452 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:12.943507 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:12.943955 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:12.944107 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:12.945698 (+ 1591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:12.945703 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:12.945706 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:12.945725 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:12.945769 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:12.945781 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:12.945889 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:12.946148 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 23:38:12.946261 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":347,"threads_started":1}
I20260808 23:38:12.947865 14555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:12.935829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:42071 (local address 127.26.207.195:46845)
0808 23:38:12.936919 (+ 1090us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:12.936965 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:12.938730 (+ 1765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:12.939577 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:12.939587 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:12.939684 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:12.940305 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:12.940324 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:12.941640 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:12.941644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:12.943368 (+ 1724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:12.943386 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:12.944233 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:12.944241 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:12.944505 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:12.945303 (+ 798us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:38:12.945305 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:12.945357 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:38:12.945450 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:12.945892 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:12.945907 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:12.945918 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 23:38:12.946137 (+ 219us) client_negotiation.cc:240] Negotiation successful
0808 23:38:12.946619 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":317,"threads_started":1}
I20260808 23:38:12.949626 14552 heartbeater.cc:347] Connected to a master server at 127.26.207.254:42071
I20260808 23:38:12.950001 14552 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:12.950889 14552 heartbeater.cc:511] Master 127.26.207.254:42071 requested a full tablet report, sending...
I20260808 23:38:12.952648 14071 ts_manager.cc:194] Registered new tserver with Master: c9afb1d6a4954a6d91038bad2ec9ba09 (127.26.207.195:40749)
I20260808 23:38:12.953575 14071 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.207.195:46845
I20260808 23:38:12.957249 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:38:12.968542 14554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:12.961850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48698 (local address 127.26.207.254:42071)
0808 23:38:12.962037 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:12.962041 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:12.962582 (+ 541us) server_negotiation.cc:407] Connection header received
0808 23:38:12.962795 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:12.962799 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:12.962874 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:12.962977 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:12.963797 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:12.964575 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:12.966259 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:12.966704 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:12.966826 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:12.967913 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:12.967918 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:12.967921 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:12.967942 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:12.967978 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:12.967990 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:12.968066 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:12.968195 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 23:38:12.968292 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 23:38:12.973215 14071 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48698:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:38:12.980765 14071 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:38:13.020219 14569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:12.994940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:42443 (local address 127.0.0.1:46936)
0808 23:38:13.007802 (+ 12862us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:13.007869 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:13.008164 (+ 295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:13.010169 (+ 2005us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:13.010178 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:13.010247 (+ 69us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:13.010831 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:13.010842 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.013176 (+ 2334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.013182 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:13.016302 (+ 3120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:13.016331 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.018967 (+ 2636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.018972 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:13.019316 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:13.019355 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 23:38:13.019512 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 23:38:13.019778 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12394,"mutex_wait_us":212,"spinlock_wait_cycles":18816,"thread_start_us":13503,"threads_started":1}
I20260808 23:38:13.020265 14570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:12.995864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37142 (local address 127.26.207.194:45119)
0808 23:38:13.008040 (+ 12176us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:13.008050 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:13.009283 (+ 1233us) server_negotiation.cc:407] Connection header received
0808 23:38:13.009422 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:13.009432 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:13.009620 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:13.009820 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:13.011103 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.012955 (+ 1852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.016683 (+ 3728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.018374 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.018539 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:13.018805 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:13.019710 (+ 905us) server_negotiation.cc:299] Negotiation successful
0808 23:38:13.019888 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11976,"thread_start_us":12175,"threads_started":1}
I20260808 23:38:13.020255 14568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:12.995236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46936 (local address 127.26.207.193:42443)
0808 23:38:13.009070 (+ 13834us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:13.009078 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:13.009112 (+ 34us) server_negotiation.cc:407] Connection header received
0808 23:38:13.009253 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:13.009262 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:13.009582 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:13.009820 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:13.011103 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.012937 (+ 1834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.016683 (+ 3746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.018374 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.018586 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:13.018805 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:13.019613 (+ 808us) server_negotiation.cc:299] Negotiation successful
0808 23:38:13.019837 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13649,"thread_start_us":13463,"threads_started":1}
I20260808 23:38:13.022183 14567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:12.995357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:45119 (local address 127.0.0.1:37142)
0808 23:38:13.009146 (+ 13789us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:13.009165 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:13.009290 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:13.010169 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:13.010178 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:13.010247 (+ 69us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:13.010827 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:13.010842 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.013176 (+ 2334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.013182 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:13.016305 (+ 3123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:13.016331 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.018924 (+ 2593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.018934 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:13.019275 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:13.019349 (+ 74us) client_negotiation.cc:769] Sending connection context
0808 23:38:13.019530 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 23:38:13.021261 (+ 1731us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13650,"mutex_wait_us":1184,"spinlock_wait_cycles":12288,"thread_start_us":13040,"threads_started":1}
I20260808 23:38:13.025177 14201 tablet_service.cc:1467] Processing CreateTablet for tablet 5f0c9100db7e4f97a491fa1bd0ad324c (DEFAULT_TABLE table=test-table [id=fb969d50dcbd4cabbe586cc5a94141d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:13.026943 14201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f0c9100db7e4f97a491fa1bd0ad324c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:13.026373 14341 tablet_service.cc:1467] Processing CreateTablet for tablet 5f0c9100db7e4f97a491fa1bd0ad324c (DEFAULT_TABLE table=test-table [id=fb969d50dcbd4cabbe586cc5a94141d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:13.027901 14341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f0c9100db7e4f97a491fa1bd0ad324c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:13.028452 14572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:13.010048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37960 (local address 127.26.207.195:40749)
0808 23:38:13.019527 (+ 9479us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:13.019537 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:13.019575 (+ 38us) server_negotiation.cc:407] Connection header received
0808 23:38:13.019684 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:13.019693 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:13.019995 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:13.020242 (+ 247us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:13.021718 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.023435 (+ 1717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.025660 (+ 2225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.027254 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.027480 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:13.027803 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:13.027889 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 23:38:13.028066 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9233,"thread_start_us":9046,"threads_started":1}
I20260808 23:38:13.028466 14571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:13.009733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:40749 (local address 127.0.0.1:37960)
0808 23:38:13.016643 (+ 6910us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:13.016675 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:13.016888 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:13.020701 (+ 3813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:13.020706 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:13.020740 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:13.021455 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:13.021470 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.023598 (+ 2128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.023604 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:13.025426 (+ 1822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:13.025445 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.027479 (+ 2034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.027486 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:13.027675 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:13.027710 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 23:38:13.027796 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 23:38:13.028057 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6660,"mutex_wait_us":238,"thread_start_us":7275,"threads_started":1}
I20260808 23:38:13.032562 14480 tablet_service.cc:1467] Processing CreateTablet for tablet 5f0c9100db7e4f97a491fa1bd0ad324c (DEFAULT_TABLE table=test-table [id=fb969d50dcbd4cabbe586cc5a94141d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:13.034188 14480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f0c9100db7e4f97a491fa1bd0ad324c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:13.044510 14573 tablet_bootstrap.cc:492] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af: Bootstrap starting.
I20260808 23:38:13.045527 14574 tablet_bootstrap.cc:492] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76: Bootstrap starting.
I20260808 23:38:13.049162 14575 tablet_bootstrap.cc:492] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09: Bootstrap starting.
I20260808 23:38:13.049782 14574 tablet_bootstrap.cc:654] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:13.050535 14573 tablet_bootstrap.cc:654] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:13.051306 14574 log.cc:824] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:13.051898 14573 log.cc:824] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:13.053591 14575 tablet_bootstrap.cc:654] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:13.055016 14575 log.cc:824] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:13.056241 14574 tablet_bootstrap.cc:492] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76: No bootstrap required, opened a new log
I20260808 23:38:13.056237 14573 tablet_bootstrap.cc:492] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af: No bootstrap required, opened a new log
I20260808 23:38:13.056571 14574 ts_tablet_manager.cc:1397] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.002s
I20260808 23:38:13.056572 14573 ts_tablet_manager.cc:1397] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.003s
I20260808 23:38:13.058084 14575 tablet_bootstrap.cc:492] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09: No bootstrap required, opened a new log
I20260808 23:38:13.058414 14575 ts_tablet_manager.cc:1397] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 23:38:13.067029 14575 raft_consensus.cc:348] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1821562392b54125bb70f3fad3263f76" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42443 } } peers { permanent_uuid: "d3bf4534d40b4bccaac16dbb76af35af" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 45119 } } peers { permanent_uuid: "c9afb1d6a4954a6d91038bad2ec9ba09" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40749 } }
I20260808 23:38:13.067503 14575 raft_consensus.cc:374] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:13.067607 14575 raft_consensus.cc:729] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9afb1d6a4954a6d91038bad2ec9ba09, State: Initialized, Role: FOLLOWER
I20260808 23:38:13.068365 14575 consensus_queue.cc:260] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1821562392b54125bb70f3fad3263f76" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42443 } } peers { permanent_uuid: "d3bf4534d40b4bccaac16dbb76af35af" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 45119 } } peers { permanent_uuid: "c9afb1d6a4954a6d91038bad2ec9ba09" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40749 } }
I20260808 23:38:13.068375 14573 raft_consensus.cc:348] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1821562392b54125bb70f3fad3263f76" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42443 } } peers { permanent_uuid: "d3bf4534d40b4bccaac16dbb76af35af" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 45119 } } peers { permanent_uuid: "c9afb1d6a4954a6d91038bad2ec9ba09" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40749 } }
I20260808 23:38:13.068375 14574 raft_consensus.cc:348] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1821562392b54125bb70f3fad3263f76" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42443 } } peers { permanent_uuid: "d3bf4534d40b4bccaac16dbb76af35af" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 45119 } } peers { permanent_uuid: "c9afb1d6a4954a6d91038bad2ec9ba09" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40749 } }
I20260808 23:38:13.068907 14573 raft_consensus.cc:374] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:13.068928 14574 raft_consensus.cc:374] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:13.069031 14573 raft_consensus.cc:729] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3bf4534d40b4bccaac16dbb76af35af, State: Initialized, Role: FOLLOWER
I20260808 23:38:13.069031 14574 raft_consensus.cc:729] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1821562392b54125bb70f3fad3263f76, State: Initialized, Role: FOLLOWER
I20260808 23:38:13.069670 14574 consensus_queue.cc:260] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1821562392b54125bb70f3fad3263f76" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42443 } } peers { permanent_uuid: "d3bf4534d40b4bccaac16dbb76af35af" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 45119 } } peers { permanent_uuid: "c9afb1d6a4954a6d91038bad2ec9ba09" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40749 } }
I20260808 23:38:13.069669 14573 consensus_queue.cc:260] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1821562392b54125bb70f3fad3263f76" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42443 } } peers { permanent_uuid: "d3bf4534d40b4bccaac16dbb76af35af" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 45119 } } peers { permanent_uuid: "c9afb1d6a4954a6d91038bad2ec9ba09" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40749 } }
I20260808 23:38:13.073755 14552 heartbeater.cc:503] Master 127.26.207.254:42071 was elected leader, sending a full tablet report...
I20260808 23:38:13.074599 14575 ts_tablet_manager.cc:1428] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09: Time spent starting tablet: real 0.016s user 0.013s sys 0.003s
I20260808 23:38:13.074753 14412 heartbeater.cc:503] Master 127.26.207.254:42071 was elected leader, sending a full tablet report...
I20260808 23:38:13.074934 14573 ts_tablet_manager.cc:1428] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af: Time spent starting tablet: real 0.018s user 0.014s sys 0.005s
I20260808 23:38:13.076920 14574 ts_tablet_manager.cc:1428] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76: Time spent starting tablet: real 0.020s user 0.016s sys 0.004s
W20260808 23:38:13.150791 14270 tablet.cc:2369] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:38:13.157536 14581 raft_consensus.cc:482] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:38:13.157919 14581 raft_consensus.cc:504] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1821562392b54125bb70f3fad3263f76" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42443 } } peers { permanent_uuid: "d3bf4534d40b4bccaac16dbb76af35af" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 45119 } } peers { permanent_uuid: "c9afb1d6a4954a6d91038bad2ec9ba09" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40749 } }
I20260808 23:38:13.159904 14581 leader_election.cc:288] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1821562392b54125bb70f3fad3263f76 (127.26.207.193:42443), c9afb1d6a4954a6d91038bad2ec9ba09 (127.26.207.195:40749)
W20260808 23:38:13.162817 14413 tablet.cc:2369] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:38:13.167724 14568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:13.160412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:45057 (local address 127.26.207.193:42443)
0808 23:38:13.160602 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:13.160608 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:13.161359 (+ 751us) server_negotiation.cc:407] Connection header received
0808 23:38:13.161618 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:13.161624 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:13.161723 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:13.161842 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:13.162749 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.163825 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.165862 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.166708 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.166910 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:13.166988 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:13.167315 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 23:38:13.167454 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 23:38:13.167836 14583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:13.160404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:42443 (local address 127.26.207.194:45057)
0808 23:38:13.161230 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:13.161253 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:13.161418 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:13.161969 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:13.161975 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:13.162002 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:13.162550 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:13.162566 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.163961 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.163968 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:13.165629 (+ 1661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:13.165643 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.166915 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.166921 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:13.167106 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:13.167130 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 23:38:13.167271 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 23:38:13.167422 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"spinlock_wait_cycles":25856,"thread_start_us":447,"threads_started":1}
I20260808 23:38:13.168151 14572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:13.161700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:43359 (local address 127.26.207.195:40749)
0808 23:38:13.161926 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:13.161931 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:13.162162 (+ 231us) server_negotiation.cc:407] Connection header received
0808 23:38:13.162382 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:13.162387 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:13.162447 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:13.162568 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:13.163316 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.164336 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.166198 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.166990 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.167239 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:13.167310 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:13.167618 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 23:38:13.167757 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 23:38:13.168363 14584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:13.161367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:40749 (local address 127.26.207.194:43359)
0808 23:38:13.162041 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:13.162065 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:13.162210 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:13.162604 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:13.162612 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:13.162643 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:13.163125 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:13.163138 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.164487 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.164492 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:13.165998 (+ 1506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:13.166011 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.167251 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.167257 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:13.167446 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:13.167471 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 23:38:13.167586 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 23:38:13.167727 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"mutex_wait_us":3,"thread_start_us":358,"threads_started":1}
I20260808 23:38:13.169047 14221 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f0c9100db7e4f97a491fa1bd0ad324c" candidate_uuid: "d3bf4534d40b4bccaac16dbb76af35af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1821562392b54125bb70f3fad3263f76" is_pre_election: true
I20260808 23:38:13.169582 14221 raft_consensus.cc:2454] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3bf4534d40b4bccaac16dbb76af35af in term 0.
I20260808 23:38:13.170341 14292 leader_election.cc:302] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1821562392b54125bb70f3fad3263f76, d3bf4534d40b4bccaac16dbb76af35af; no voters:
I20260808 23:38:13.170331 14503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f0c9100db7e4f97a491fa1bd0ad324c" candidate_uuid: "d3bf4534d40b4bccaac16dbb76af35af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9afb1d6a4954a6d91038bad2ec9ba09" is_pre_election: true
I20260808 23:38:13.170800 14581 raft_consensus.cc:2781] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:38:13.170872 14503 raft_consensus.cc:2454] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3bf4534d40b4bccaac16dbb76af35af in term 0.
I20260808 23:38:13.170962 14581 raft_consensus.cc:482] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:38:13.171083 14581 raft_consensus.cc:3037] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:13.173657 14581 raft_consensus.cc:504] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1821562392b54125bb70f3fad3263f76" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42443 } } peers { permanent_uuid: "d3bf4534d40b4bccaac16dbb76af35af" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 45119 } } peers { permanent_uuid: "c9afb1d6a4954a6d91038bad2ec9ba09" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40749 } }
I20260808 23:38:13.174295 14581 leader_election.cc:288] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [CANDIDATE]: Term 1 election: Requested vote from peers 1821562392b54125bb70f3fad3263f76 (127.26.207.193:42443), c9afb1d6a4954a6d91038bad2ec9ba09 (127.26.207.195:40749)
I20260808 23:38:13.174962 14221 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f0c9100db7e4f97a491fa1bd0ad324c" candidate_uuid: "d3bf4534d40b4bccaac16dbb76af35af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1821562392b54125bb70f3fad3263f76"
I20260808 23:38:13.175259 14221 raft_consensus.cc:3037] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:13.175463 14503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f0c9100db7e4f97a491fa1bd0ad324c" candidate_uuid: "d3bf4534d40b4bccaac16dbb76af35af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9afb1d6a4954a6d91038bad2ec9ba09"
I20260808 23:38:13.175992 14503 raft_consensus.cc:3037] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:13.178627 14221 raft_consensus.cc:2454] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3bf4534d40b4bccaac16dbb76af35af in term 1.
I20260808 23:38:13.178741 14503 raft_consensus.cc:2454] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3bf4534d40b4bccaac16dbb76af35af in term 1.
I20260808 23:38:13.179148 14292 leader_election.cc:302] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1821562392b54125bb70f3fad3263f76, d3bf4534d40b4bccaac16dbb76af35af; no voters:
I20260808 23:38:13.179503 14581 raft_consensus.cc:2781] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:13.180078 14581 raft_consensus.cc:686] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [term 1 LEADER]: Becoming Leader. State: Replica: d3bf4534d40b4bccaac16dbb76af35af, State: Running, Role: LEADER
I20260808 23:38:13.180611 14581 consensus_queue.cc:237] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1821562392b54125bb70f3fad3263f76" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42443 } } peers { permanent_uuid: "d3bf4534d40b4bccaac16dbb76af35af" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 45119 } } peers { permanent_uuid: "c9afb1d6a4954a6d91038bad2ec9ba09" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40749 } }
W20260808 23:38:13.184123 14553 tablet.cc:2369] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:38:13.186136 14071 catalog_manager.cc:5495] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af reported cstate change: term changed from 0 to 1, leader changed from <none> to d3bf4534d40b4bccaac16dbb76af35af (127.26.207.194). New cstate: current_term: 1 leader_uuid: "d3bf4534d40b4bccaac16dbb76af35af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1821562392b54125bb70f3fad3263f76" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3bf4534d40b4bccaac16dbb76af35af" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9afb1d6a4954a6d91038bad2ec9ba09" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40749 } health_report { overall_health: UNKNOWN } } }
I20260808 23:38:13.228025 14570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:13.221802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37154 (local address 127.26.207.194:45119)
0808 23:38:13.222089 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:13.222094 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:13.222114 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:38:13.222315 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:13.222319 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:13.222435 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:13.222578 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:38:13.223028 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.223784 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.225451 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.225915 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.226082 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:13.226683 (+ 601us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:38:13.227328 (+ 645us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:38:13.227463 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:13.227626 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 23:38:13.227704 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 23:38:13.238010 14503 raft_consensus.cc:1261] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09 [term 1 FOLLOWER]: Refusing update from remote peer d3bf4534d40b4bccaac16dbb76af35af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:38:13.238054 14221 raft_consensus.cc:1261] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76 [term 1 FOLLOWER]: Refusing update from remote peer d3bf4534d40b4bccaac16dbb76af35af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:38:13.239243 14585 consensus_queue.cc:1035] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9afb1d6a4954a6d91038bad2ec9ba09" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:38:13.239711 14581 consensus_queue.cc:1035] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [LEADER]: Connected to new peer: Peer: permanent_uuid: "1821562392b54125bb70f3fad3263f76" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 42443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:38:13.267086 14590 mvcc.cc:205] Tried to move back new op lower bound from 7316407473089982464 to 7316407472872374272. Current Snapshot: MvccSnapshot[applied={T|T < 7316407473089982464}]
I20260808 23:38:13.284233 14068 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:38:13.284613 14068 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:38:13.289198 14068 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b8fa0c3d47c4239a3f661422b86608d: Sending DeleteTablet for 3 replicas of tablet 5f0c9100db7e4f97a491fa1bd0ad324c
I20260808 23:38:13.290807 14341 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f0c9100db7e4f97a491fa1bd0ad324c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:13 UTC) from {username='slave'} at 127.0.0.1:37142
I20260808 23:38:13.290949 14201 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f0c9100db7e4f97a491fa1bd0ad324c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:13 UTC) from {username='slave'} at 127.0.0.1:46936
I20260808 23:38:13.291863 14480 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f0c9100db7e4f97a491fa1bd0ad324c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:13 UTC) from {username='slave'} at 127.0.0.1:37960
I20260808 23:38:13.292100 14602 tablet_replica.cc:330] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af: stopping tablet replica
I20260808 23:38:13.292605 14602 raft_consensus.cc:2229] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:38:13.293412 14602 raft_consensus.cc:2258] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:13.293751 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 14133
I20260808 23:38:13.295702 14602 ts_tablet_manager.cc:1905] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:13.305361 14601 tablet_replica.cc:330] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76: stopping tablet replica
I20260808 23:38:13.306025 14601 raft_consensus.cc:2229] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:38:13.306679 14601 raft_consensus.cc:2258] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:13.309574 14601 ts_tablet_manager.cc:1905] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:13.310173 14602 ts_tablet_manager.cc:1918] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:13.310470 14602 log.cc:1196] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/5f0c9100db7e4f97a491fa1bd0ad324c
I20260808 23:38:13.311206 14602 ts_tablet_manager.cc:1939] T 5f0c9100db7e4f97a491fa1bd0ad324c P d3bf4534d40b4bccaac16dbb76af35af: Deleting consensus metadata
I20260808 23:38:13.313815 14056 catalog_manager.cc:4841] TS d3bf4534d40b4bccaac16dbb76af35af (127.26.207.194:45119): tablet 5f0c9100db7e4f97a491fa1bd0ad324c (table test-table [id=fb969d50dcbd4cabbe586cc5a94141d7]) successfully deleted
I20260808 23:38:13.318310 14603 tablet_replica.cc:330] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09: stopping tablet replica
I20260808 23:38:13.318701 14601 ts_tablet_manager.cc:1918] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:13.318907 14601 log.cc:1196] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/5f0c9100db7e4f97a491fa1bd0ad324c
I20260808 23:38:13.318892 14603 raft_consensus.cc:2229] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:38:13.319556 14603 raft_consensus.cc:2258] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:13.319608 14601 ts_tablet_manager.cc:1939] T 5f0c9100db7e4f97a491fa1bd0ad324c P 1821562392b54125bb70f3fad3263f76: Deleting consensus metadata
I20260808 23:38:13.321971 14053 catalog_manager.cc:4841] TS 1821562392b54125bb70f3fad3263f76 (127.26.207.193:42443): tablet 5f0c9100db7e4f97a491fa1bd0ad324c (table test-table [id=fb969d50dcbd4cabbe586cc5a94141d7]) successfully deleted
I20260808 23:38:13.324990 14603 ts_tablet_manager.cc:1905] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:13.329983 14568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:13.305188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46946 (local address 127.26.207.193:42443)
0808 23:38:13.305434 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:13.305441 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:13.317624 (+ 12183us) server_negotiation.cc:407] Connection header received
0808 23:38:13.320389 (+ 2765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:13.320396 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:13.320525 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:13.320650 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:13.321607 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.323163 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.325289 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.325970 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.326127 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:13.327654 (+ 1527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:13.327667 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:13.327689 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:13.328541 (+ 852us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:13.328610 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:13.328641 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:13.328802 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:13.329020 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 23:38:13.329304 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 23:38:13.330960 14264 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:13.334263 14603 ts_tablet_manager.cc:1918] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:13.334534 14603 log.cc:1196] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/5f0c9100db7e4f97a491fa1bd0ad324c
I20260808 23:38:13.335064 14603 ts_tablet_manager.cc:1939] T 5f0c9100db7e4f97a491fa1bd0ad324c P c9afb1d6a4954a6d91038bad2ec9ba09: Deleting consensus metadata
I20260808 23:38:13.336861 14053 catalog_manager.cc:4841] TS c9afb1d6a4954a6d91038bad2ec9ba09 (127.26.207.195:40749): tablet 5f0c9100db7e4f97a491fa1bd0ad324c (table test-table [id=fb969d50dcbd4cabbe586cc5a94141d7]) successfully deleted
I20260808 23:38:13.470136 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 14133
I20260808 23:38:13.493134 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 14275
I20260808 23:38:13.501660 14570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:13.494022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37156 (local address 127.26.207.194:45119)
0808 23:38:13.494193 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:13.494197 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:13.494216 (+ 19us) server_negotiation.cc:407] Connection header received
0808 23:38:13.494410 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:13.494414 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:13.494499 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:13.494591 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:13.495112 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.495935 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.498142 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.498767 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.498874 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:13.500059 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:13.500068 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:13.500083 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:13.500748 (+ 665us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:13.500868 (+ 120us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:13.500891 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:13.500978 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:13.501153 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 23:38:13.501240 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 23:38:13.502425 14406 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:13.623004 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 14275
I20260808 23:38:13.646286 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 14416
I20260808 23:38:13.653359 14572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:13.647165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37972 (local address 127.26.207.195:40749)
0808 23:38:13.647366 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:13.647370 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:13.647400 (+ 30us) server_negotiation.cc:407] Connection header received
0808 23:38:13.647563 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:13.647568 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:13.647655 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:13.647755 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:13.648158 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.648983 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.650253 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:13.650640 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:13.650733 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:13.651813 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:13.651822 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:13.651837 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:13.652464 (+ 627us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:13.652518 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:13.652539 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:13.652628 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:13.652772 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 23:38:13.652984 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 23:38:13.654127 14547 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:13.745772 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 14416
I20260808 23:38:13.766933 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 14037
I20260808 23:38:13.768167 14104 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:13.880848 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 14037
2026-08-08T23:38:13Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3243 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:14 dist-test-slave-1x4g krb5kdc[14611](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:14 dist-test-slave-1x4g krb5kdc[14611](info): set up 2 sockets
Aug 08 23:38:14 dist-test-slave-1x4g krb5kdc[14611](info): commencing operation
krb5kdc: starting...
W20260808 23:38:15.090024 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:38:15 dist-test-slave-1x4g krb5kdc[14611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:38:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:38:15.457338 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:40551
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:42599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:40551
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:15.834983 14624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:15.835319 14624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:15.835479 14624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:15.843097 14624 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:15.843227 14624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:15.843312 14624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:15.843420 14624 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:15.843497 14624 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:15.854032 14624 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:42599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:40551
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:40551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:15.855521 14624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:15.857064 14624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:15.870287 14631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:15.870225 14634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:15.870312 14632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:15.871410 14624 server_base.cc:1034] running on GCE node
I20260808 23:38:15.872294 14624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:15.874173 14624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:15.875499 14624 hybrid_clock.cc:648] HybridClock initialized: now 1786232295875441 us; error 78 us; skew 500 ppm
I20260808 23:38:15.876003 14624 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:15 dist-test-slave-1x4g krb5kdc[14611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232295, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:15.885130 14624 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:38:15.886933 14624 webserver.cc:460] Webserver started at http://127.26.207.254:34649/ using document root <none> and password file <none>
I20260808 23:38:15.887724 14624 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:15.887846 14624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:15.888131 14624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:15.891600 14624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "7720edb83024495399e4ec6824049af7"
format_stamp: "Formatted at 2026-08-08 23:38:15 on dist-test-slave-1x4g"
server_key: "1f49c8d20a44601d00822ad04641bc74"
server_key_iv: "cf7a1a01687f55b134768972c60f0227"
server_key_version: "encryptionkey@0"
I20260808 23:38:15.892413 14624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "7720edb83024495399e4ec6824049af7"
format_stamp: "Formatted at 2026-08-08 23:38:15 on dist-test-slave-1x4g"
server_key: "1f49c8d20a44601d00822ad04641bc74"
server_key_iv: "cf7a1a01687f55b134768972c60f0227"
server_key_version: "encryptionkey@0"
I20260808 23:38:15.898415 14624 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.003s
I20260808 23:38:15.902374 14641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:15.903982 14624 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:38:15.904165 14624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "7720edb83024495399e4ec6824049af7"
format_stamp: "Formatted at 2026-08-08 23:38:15 on dist-test-slave-1x4g"
server_key: "1f49c8d20a44601d00822ad04641bc74"
server_key_iv: "cf7a1a01687f55b134768972c60f0227"
server_key_version: "encryptionkey@0"
I20260808 23:38:15.904371 14624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:15.935016 14624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:15.940011 14624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:15.940289 14624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:15.961627 14624 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:40551
I20260808 23:38:15.961635 14697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:40551 every 8 connection(s)
I20260808 23:38:15.963258 14624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:15.965683 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 14624
I20260808 23:38:15.965901 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:15.966538 27455 external_mini_cluster.cc:1428] Setting key 3563e2f8206e4a372aa800fa6c6b965e
I20260808 23:38:15.968346 14698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:15.981848 14698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7: Bootstrap starting.
Aug 08 23:38:15 dist-test-slave-1x4g krb5kdc[14611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:38:15.986578 14698 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:15.987879 14698 log.cc:824] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:15.992022 14698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7: No bootstrap required, opened a new log
I20260808 23:38:15.993227 14701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:15.968834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48434 (local address 127.26.207.254:40551)
0808 23:38:15.969726 (+ 892us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:15.969739 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:15.969782 (+ 43us) server_negotiation.cc:407] Connection header received
0808 23:38:15.971583 (+ 1801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:15.971611 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:15.972100 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:15.972586 (+ 486us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:15.974274 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:15.975748 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:15.977361 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:15.978135 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:15.978406 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:15.983664 (+ 5258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:15.983674 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:15.983695 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:15.983752 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:15.987599 (+ 3847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:15.988831 (+ 1232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:15.988847 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:15.988856 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:15.989168 (+ 312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:15.989721 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:15.989725 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:15.989727 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:15.990393 (+ 666us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:15.990643 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:15.991342 (+ 699us) server_negotiation.cc:299] Negotiation successful
0808 23:38:15.991843 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":661,"thread_start_us":389,"threads_started":1}
I20260808 23:38:16.000578 14698 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7720edb83024495399e4ec6824049af7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40551 } }
I20260808 23:38:16.001145 14698 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:16.001312 14698 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7720edb83024495399e4ec6824049af7, State: Initialized, Role: FOLLOWER
I20260808 23:38:16.002125 14698 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7720edb83024495399e4ec6824049af7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40551 } }
I20260808 23:38:16.002377 14698 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:16.002558 14698 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:16.002754 14698 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:16.005393 14698 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7720edb83024495399e4ec6824049af7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40551 } }
I20260808 23:38:16.006052 14698 leader_election.cc:302] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7720edb83024495399e4ec6824049af7; no voters:
I20260808 23:38:16.006953 14698 leader_election.cc:288] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:16.007510 14704 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:16.008641 14704 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [term 1 LEADER]: Becoming Leader. State: Replica: 7720edb83024495399e4ec6824049af7, State: Running, Role: LEADER
I20260808 23:38:16.009588 14704 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7720edb83024495399e4ec6824049af7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40551 } }
I20260808 23:38:16.009825 14698 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:16.013645 14705 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7720edb83024495399e4ec6824049af7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7720edb83024495399e4ec6824049af7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40551 } } }
I20260808 23:38:16.014263 14705 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:16.013655 14706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7720edb83024495399e4ec6824049af7. Latest consensus state: current_term: 1 leader_uuid: "7720edb83024495399e4ec6824049af7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7720edb83024495399e4ec6824049af7" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40551 } } }
I20260808 23:38:16.014804 14706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:16.017623 14713 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:16.023847 14713 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:16.034420 14713 catalog_manager.cc:1347] Generated new cluster ID: f685dd1b9f1d49dd9ef19844725d61e7
I20260808 23:38:16.034598 14713 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:16.070185 14713 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:16.071656 14713 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:16.086503 14713 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7: Generated new TSK 0
I20260808 23:38:16.087548 14713 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:38:16.180863 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:40551
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:42599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:16.590814 14726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:16.591154 14726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:16.591325 14726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:16.599145 14726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:16.599290 14726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:16.599486 14726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:38:16.610235 14726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:42599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:40551
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:16.611708 14726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:16.613220 14726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:16.628715 14734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:16.628750 14738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:16.628643 14735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:16.629571 14726 server_base.cc:1034] running on GCE node
I20260808 23:38:16.630422 14726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:16.631631 14726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:16.632948 14726 hybrid_clock.cc:648] HybridClock initialized: now 1786232296632864 us; error 64 us; skew 500 ppm
I20260808 23:38:16.633334 14726 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:16 dist-test-slave-1x4g krb5kdc[14611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232296, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:16.637190 14726 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:38:16.638942 14726 webserver.cc:460] Webserver started at http://127.26.207.193:37643/ using document root <none> and password file <none>
I20260808 23:38:16.639772 14726 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:16.639953 14726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:16.640319 14726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:16.643674 14726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "c2abdc4da9bf431681909160a2655e14"
format_stamp: "Formatted at 2026-08-08 23:38:16 on dist-test-slave-1x4g"
server_key: "6244659e25cf1b34b06c0d2818ef13a0"
server_key_iv: "9873508ae6e79a9dbeeb073a465fc3a8"
server_key_version: "encryptionkey@0"
I20260808 23:38:16.644658 14726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "c2abdc4da9bf431681909160a2655e14"
format_stamp: "Formatted at 2026-08-08 23:38:16 on dist-test-slave-1x4g"
server_key: "6244659e25cf1b34b06c0d2818ef13a0"
server_key_iv: "9873508ae6e79a9dbeeb073a465fc3a8"
server_key_version: "encryptionkey@0"
I20260808 23:38:16.651031 14726 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260808 23:38:16.655679 14745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:16.657568 14726 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 23:38:16.657773 14726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "c2abdc4da9bf431681909160a2655e14"
format_stamp: "Formatted at 2026-08-08 23:38:16 on dist-test-slave-1x4g"
server_key: "6244659e25cf1b34b06c0d2818ef13a0"
server_key_iv: "9873508ae6e79a9dbeeb073a465fc3a8"
server_key_version: "encryptionkey@0"
I20260808 23:38:16.658006 14726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:16.673877 14726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:16.678728 14726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:16.679069 14726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:16.680171 14726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:16.681903 14726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:16.682003 14726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:16.682111 14726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:16.682170 14726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:16.722169 14726 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:34707
I20260808 23:38:16.722214 14863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:34707 every 8 connection(s)
I20260808 23:38:16.723726 14726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:38:16.726874 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 14726
I20260808 23:38:16.727087 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:38:16.727567 27455 external_mini_cluster.cc:1428] Setting key 486e4fb40fe5311e9a46270232c5398a
Aug 08 23:38:16 dist-test-slave-1x4g krb5kdc[14611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232296, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:38:16.748085 14867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:16.728296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:37047 (local address 127.26.207.254:40551)
0808 23:38:16.729156 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:16.729160 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:16.729179 (+ 19us) server_negotiation.cc:407] Connection header received
0808 23:38:16.730622 (+ 1443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:16.730630 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:16.730727 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:16.730849 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:16.732564 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:16.733780 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:16.735572 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:16.736307 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:16.736473 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:16.740476 (+ 4003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:16.740486 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:16.740494 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:16.740547 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:16.744268 (+ 3721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:16.745497 (+ 1229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:16.745502 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:16.745504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:16.745643 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:16.746218 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:16.746221 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:16.746223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:16.746508 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:16.746627 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:16.747619 (+ 992us) server_negotiation.cc:299] Negotiation successful
0808 23:38:16.747811 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":763,"thread_start_us":650,"threads_started":1}
I20260808 23:38:16.749841 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:16.727214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40551 (local address 127.26.207.193:37047)
0808 23:38:16.728144 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:16.728205 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:16.730308 (+ 2103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:16.731078 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:16.731087 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:16.731673 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:16.732324 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:16.732346 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:16.733994 (+ 1648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:16.733998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:16.735388 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:16.735404 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:16.736624 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:16.736630 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:16.736960 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:16.737756 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:38:16.737780 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:16.740186 (+ 2406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:16.744490 (+ 4304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:16.744504 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:16.744529 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:16.745355 (+ 826us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:16.745773 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:16.745781 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:16.745787 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:16.746093 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:16.746646 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:16.746657 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:16.747181 (+ 524us) client_negotiation.cc:769] Sending connection context
0808 23:38:16.747510 (+ 329us) client_negotiation.cc:240] Negotiation successful
0808 23:38:16.748152 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":377,"threads_started":1}
I20260808 23:38:16.751919 14864 heartbeater.cc:347] Connected to a master server at 127.26.207.254:40551
I20260808 23:38:16.752292 14864 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:16.753193 14864 heartbeater.cc:511] Master 127.26.207.254:40551 requested a full tablet report, sending...
I20260808 23:38:16.755888 14660 ts_manager.cc:194] Registered new tserver with Master: c2abdc4da9bf431681909160a2655e14 (127.26.207.193:34707)
I20260808 23:38:16.758361 14660 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:37047
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:38:16.810664 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:40551
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:42599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:17.193317 14870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:17.193655 14870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:17.193756 14870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:17.201363 14870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:17.201502 14870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:17.201622 14870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:38:17.212421 14870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:42599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:40551
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:17.213981 14870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:17.215503 14870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:17.230684 14875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:17.230790 14880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:17.230755 14876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:17.232373 14870 server_base.cc:1034] running on GCE node
I20260808 23:38:17.233174 14870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:17.234222 14870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:17.235446 14870 hybrid_clock.cc:648] HybridClock initialized: now 1786232297235376 us; error 61 us; skew 500 ppm
I20260808 23:38:17.235754 14870 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:17 dist-test-slave-1x4g krb5kdc[14611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232297, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:17.239264 14870 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:38:17.240932 14870 webserver.cc:460] Webserver started at http://127.26.207.194:34217/ using document root <none> and password file <none>
I20260808 23:38:17.241662 14870 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:17.241776 14870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:17.242079 14870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:17.245414 14870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "de1dac9472c44d91b40ba1f140799260"
format_stamp: "Formatted at 2026-08-08 23:38:17 on dist-test-slave-1x4g"
server_key: "ef1d61d0ee09051847dc938fd7652f1e"
server_key_iv: "6c73ff182b372e23e17d2acf2fc8dc8d"
server_key_version: "encryptionkey@0"
I20260808 23:38:17.246333 14870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "de1dac9472c44d91b40ba1f140799260"
format_stamp: "Formatted at 2026-08-08 23:38:17 on dist-test-slave-1x4g"
server_key: "ef1d61d0ee09051847dc938fd7652f1e"
server_key_iv: "6c73ff182b372e23e17d2acf2fc8dc8d"
server_key_version: "encryptionkey@0"
I20260808 23:38:17.252424 14870 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 23:38:17.256721 14888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:17.258656 14870 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:38:17.258884 14870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "de1dac9472c44d91b40ba1f140799260"
format_stamp: "Formatted at 2026-08-08 23:38:17 on dist-test-slave-1x4g"
server_key: "ef1d61d0ee09051847dc938fd7652f1e"
server_key_iv: "6c73ff182b372e23e17d2acf2fc8dc8d"
server_key_version: "encryptionkey@0"
I20260808 23:38:17.259125 14870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:17.284179 14870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:17.289348 14870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:17.289690 14870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:17.290807 14870 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:17.292296 14870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:17.292380 14870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:17.292544 14870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:17.292608 14870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:17.330284 14870 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:42625
I20260808 23:38:17.330376 15005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:42625 every 8 connection(s)
I20260808 23:38:17.331709 14870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:38:17.340133 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 14870
I20260808 23:38:17.340344 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:38:17.341142 27455 external_mini_cluster.cc:1428] Setting key c5374bfac4232f326df6b9a5fd4f0534
Aug 08 23:38:17 dist-test-slave-1x4g krb5kdc[14611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232297, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:38:17.355405 15008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:17.334507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:59263 (local address 127.26.207.254:40551)
0808 23:38:17.334957 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:17.334962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:17.336081 (+ 1119us) server_negotiation.cc:407] Connection header received
0808 23:38:17.338156 (+ 2075us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:17.338161 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:17.338241 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:17.338356 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:17.340422 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:17.341603 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:17.344197 (+ 2594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:17.344664 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:17.344836 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:17.348844 (+ 4008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:17.348851 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:17.348856 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:17.348905 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:17.351770 (+ 2865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:17.352696 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:17.352702 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:17.352706 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:17.352920 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:17.353418 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:17.353424 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:17.353427 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:17.353768 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:17.353936 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:17.354741 (+ 805us) server_negotiation.cc:299] Negotiation successful
0808 23:38:17.355002 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":226,"threads_started":1}
I20260808 23:38:17.356472 15009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:17.335135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40551 (local address 127.26.207.194:59263)
0808 23:38:17.335892 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:17.335939 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:17.337810 (+ 1871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:17.338614 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:17.338624 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:17.339218 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:17.340187 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:17.340222 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:17.341883 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:17.341889 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:17.344012 (+ 2123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:17.344029 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:17.344972 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:17.344981 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:17.345244 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:17.346015 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:38:17.346040 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:17.348479 (+ 2439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:17.351984 (+ 3505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:17.351996 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:17.352022 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:17.352540 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:17.353050 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:17.353055 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:17.353060 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:17.353290 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:17.353930 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:17.353939 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:17.354343 (+ 404us) client_negotiation.cc:769] Sending connection context
0808 23:38:17.354654 (+ 311us) client_negotiation.cc:240] Negotiation successful
0808 23:38:17.355271 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":294,"threads_started":1}
I20260808 23:38:17.358183 15006 heartbeater.cc:347] Connected to a master server at 127.26.207.254:40551
I20260808 23:38:17.358594 15006 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:17.359604 15006 heartbeater.cc:511] Master 127.26.207.254:40551 requested a full tablet report, sending...
I20260808 23:38:17.361423 14660 ts_manager.cc:194] Registered new tserver with Master: de1dac9472c44d91b40ba1f140799260 (127.26.207.194:42625)
I20260808 23:38:17.362422 14660 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:59263
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:38:17.421370 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:40551
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:42599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:38:17.762360 14864 heartbeater.cc:503] Master 127.26.207.254:40551 was elected leader, sending a full tablet report...
W20260808 23:38:17.792064 15012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:17.792392 15012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:17.792495 15012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:17.800235 15012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:17.800376 15012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:17.800495 15012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:38:17.811226 15012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:42599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:40551
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:17.812691 15012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:17.814244 15012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:17.829540 15019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:17.829600 15021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:17.829576 15018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:17.830487 15012 server_base.cc:1034] running on GCE node
I20260808 23:38:17.831202 15012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:17.832293 15012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:17.833534 15012 hybrid_clock.cc:648] HybridClock initialized: now 1786232297833498 us; error 53 us; skew 500 ppm
I20260808 23:38:17.833884 15012 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:17 dist-test-slave-1x4g krb5kdc[14611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232297, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:17.837357 15012 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:38:17.839131 15012 webserver.cc:460] Webserver started at http://127.26.207.195:46801/ using document root <none> and password file <none>
I20260808 23:38:17.839941 15012 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:17.840122 15012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:17.840484 15012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:17.843896 15012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "21eaed305ff040598ef5a7b7f548eb16"
format_stamp: "Formatted at 2026-08-08 23:38:17 on dist-test-slave-1x4g"
server_key: "91c37727260a6e3fe02f031f2fe55c67"
server_key_iv: "162ba858b9a48d270de452c738bbf376"
server_key_version: "encryptionkey@0"
I20260808 23:38:17.844870 15012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "21eaed305ff040598ef5a7b7f548eb16"
format_stamp: "Formatted at 2026-08-08 23:38:17 on dist-test-slave-1x4g"
server_key: "91c37727260a6e3fe02f031f2fe55c67"
server_key_iv: "162ba858b9a48d270de452c738bbf376"
server_key_version: "encryptionkey@0"
I20260808 23:38:17.850672 15012 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 23:38:17.854682 15029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:17.856209 15012 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 23:38:17.856431 15012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "21eaed305ff040598ef5a7b7f548eb16"
format_stamp: "Formatted at 2026-08-08 23:38:17 on dist-test-slave-1x4g"
server_key: "91c37727260a6e3fe02f031f2fe55c67"
server_key_iv: "162ba858b9a48d270de452c738bbf376"
server_key_version: "encryptionkey@0"
I20260808 23:38:17.856703 15012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:17.879272 15012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:17.883930 15012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:17.884289 15012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:17.885461 15012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:17.886974 15012 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:17.887100 15012 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:17.887260 15012 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:17.887334 15012 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:17.924013 15012 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:39145
I20260808 23:38:17.924073 15147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:39145 every 8 connection(s)
I20260808 23:38:17.925572 15012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:38:17.928072 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 15012
I20260808 23:38:17.928296 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:38:17.928949 27455 external_mini_cluster.cc:1428] Setting key bbe95d0d0c204415ca05293505cf764d
Aug 08 23:38:17 dist-test-slave-1x4g krb5kdc[14611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232297, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:38:17.948257 15151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:17.928462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:54843 (local address 127.26.207.254:40551)
0808 23:38:17.928987 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:17.928994 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:17.930269 (+ 1275us) server_negotiation.cc:407] Connection header received
0808 23:38:17.932357 (+ 2088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:17.932361 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:17.932458 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:17.932553 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:17.934310 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:17.935134 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:17.936982 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:17.937440 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:17.937554 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:17.941511 (+ 3957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:17.941517 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:17.941521 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:17.941563 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:17.944902 (+ 3339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:17.945729 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:17.945734 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:17.945738 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:17.945876 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:17.946351 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:17.946360 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:17.946362 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:17.946650 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:17.946826 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:17.947617 (+ 791us) server_negotiation.cc:299] Negotiation successful
0808 23:38:17.947864 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":237,"threads_started":1}
I20260808 23:38:17.949416 15152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:17.929185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40551 (local address 127.26.207.195:54843)
0808 23:38:17.930091 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:17.930140 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:17.932067 (+ 1927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:17.932859 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:17.932868 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:17.933455 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:17.934086 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:17.934107 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:17.935320 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:17.935324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:17.936722 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:17.936739 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:17.937689 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:17.937695 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:17.937932 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:17.938652 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:38:17.938685 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:17.941199 (+ 2514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:17.945072 (+ 3873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:17.945081 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:17.945099 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:17.945577 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:17.945997 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:17.946012 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:17.946015 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:17.946218 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:17.946791 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:17.946800 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:17.947202 (+ 402us) client_negotiation.cc:769] Sending connection context
0808 23:38:17.947488 (+ 286us) client_negotiation.cc:240] Negotiation successful
0808 23:38:17.948088 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":368,"threads_started":1}
I20260808 23:38:17.951033 15149 heartbeater.cc:347] Connected to a master server at 127.26.207.254:40551
I20260808 23:38:17.951408 15149 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:17.952217 15149 heartbeater.cc:511] Master 127.26.207.254:40551 requested a full tablet report, sending...
I20260808 23:38:17.953904 14660 ts_manager.cc:194] Registered new tserver with Master: 21eaed305ff040598ef5a7b7f548eb16 (127.26.207.195:39145)
I20260808 23:38:17.954799 14660 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:54843
I20260808 23:38:17.957333 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:38:17.978386 15151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:17.962181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48444 (local address 127.26.207.254:40551)
0808 23:38:17.962407 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:17.962415 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:17.962980 (+ 565us) server_negotiation.cc:407] Connection header received
0808 23:38:17.963192 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:17.963196 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:17.963288 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:17.963407 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:17.965340 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:17.966116 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:17.968201 (+ 2085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:17.968641 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:17.968746 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:17.972502 (+ 3756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:17.972509 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:17.972513 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:17.972555 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:17.975300 (+ 2745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:17.976232 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:17.976235 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:17.976238 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:17.976369 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:17.976896 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:17.976900 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:17.976902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:17.977250 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:17.977457 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:17.977847 (+ 390us) server_negotiation.cc:299] Negotiation successful
0808 23:38:17.978018 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 23:38:17.982718 14660 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48444:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:38:17.990087 14660 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:38:18.019014 15164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:18.004596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:42625 (local address 127.0.0.1:51400)
0808 23:38:18.005831 (+ 1235us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:18.005850 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:18.005978 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:18.007029 (+ 1051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:18.007038 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:18.007076 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:18.007686 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:18.007702 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.010491 (+ 2789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.010500 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:18.014129 (+ 3629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:18.014156 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.017496 (+ 3340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.017506 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:18.017841 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:18.017942 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 23:38:18.018126 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 23:38:18.018420 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1101,"thread_start_us":925,"threads_started":1}
I20260808 23:38:18.020193 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:18.005202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51400 (local address 127.26.207.194:42625)
0808 23:38:18.006041 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:18.006050 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:18.006082 (+ 32us) server_negotiation.cc:407] Connection header received
0808 23:38:18.006184 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:18.006191 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:18.006433 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:18.006676 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:18.007977 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.010272 (+ 2295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.014427 (+ 4155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.016742 (+ 2315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.017026 (+ 284us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:18.017300 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:18.019696 (+ 2396us) server_negotiation.cc:299] Negotiation successful
0808 23:38:18.019916 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":883,"threads_started":1}
I20260808 23:38:18.021499 15162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:18.003573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:34707 (local address 127.0.0.1:33814)
0808 23:38:18.004846 (+ 1273us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:18.004904 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:18.005091 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:18.006190 (+ 1099us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:18.006197 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:18.006241 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:18.006783 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:18.006801 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.013352 (+ 6551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.013362 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:18.018330 (+ 4968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:18.018354 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.020592 (+ 2238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.020597 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:18.020739 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:18.020766 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 23:38:18.020937 (+ 171us) client_negotiation.cc:240] Negotiation successful
0808 23:38:18.021101 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":952,"thread_start_us":1723,"threads_started":1}
I20260808 23:38:18.021514 15163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:18.003794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33814 (local address 127.26.207.193:34707)
0808 23:38:18.005473 (+ 1679us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:18.005484 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:18.005521 (+ 37us) server_negotiation.cc:407] Connection header received
0808 23:38:18.005648 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:18.005658 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:18.005941 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:18.008830 (+ 2889us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:18.009145 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.013135 (+ 3990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.018665 (+ 5530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.020339 (+ 1674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.020591 (+ 252us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:18.020808 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:18.020990 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 23:38:18.021152 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1487,"thread_start_us":1340,"threads_started":1}
I20260808 23:38:18.024662 14938 tablet_service.cc:1467] Processing CreateTablet for tablet 6668ec0f87bf4104ba3877eecbbaf24c (DEFAULT_TABLE table=test-table [id=35bec73676a8432980883de36b6ca749]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:18.025228 14797 tablet_service.cc:1467] Processing CreateTablet for tablet 6668ec0f87bf4104ba3877eecbbaf24c (DEFAULT_TABLE table=test-table [id=35bec73676a8432980883de36b6ca749]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:18.026684 14797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6668ec0f87bf4104ba3877eecbbaf24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:18.026707 14938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6668ec0f87bf4104ba3877eecbbaf24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:18.027844 15164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:18.006268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:39145 (local address 127.0.0.1:35060)
0808 23:38:18.019336 (+ 13068us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:18.019355 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:18.019494 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:18.021425 (+ 1931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:18.021434 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:18.021465 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:18.021943 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:18.021960 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.023967 (+ 2007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.023972 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:18.025547 (+ 1575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:18.025565 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.026998 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.027004 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:18.027189 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:18.027227 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 23:38:18.027355 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 23:38:18.027522 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12942,"thread_start_us":13470,"threads_started":1}
I20260808 23:38:18.027945 15167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:18.006692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35060 (local address 127.26.207.195:39145)
0808 23:38:18.019259 (+ 12567us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:18.019269 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:18.019857 (+ 588us) server_negotiation.cc:407] Connection header received
0808 23:38:18.019991 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:18.019999 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:18.020284 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:18.021066 (+ 782us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:18.022168 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.023783 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.025756 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.026817 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.027014 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:18.027206 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:18.027420 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 23:38:18.027596 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12347,"thread_start_us":12582,"threads_started":1}
I20260808 23:38:18.031840 15081 tablet_service.cc:1467] Processing CreateTablet for tablet 6668ec0f87bf4104ba3877eecbbaf24c (DEFAULT_TABLE table=test-table [id=35bec73676a8432980883de36b6ca749]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:18.033489 15081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6668ec0f87bf4104ba3877eecbbaf24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:18.043022 15168 tablet_bootstrap.cc:492] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260: Bootstrap starting.
I20260808 23:38:18.043905 15169 tablet_bootstrap.cc:492] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14: Bootstrap starting.
I20260808 23:38:18.047415 15170 tablet_bootstrap.cc:492] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16: Bootstrap starting.
I20260808 23:38:18.048134 15168 tablet_bootstrap.cc:654] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:18.048300 15169 tablet_bootstrap.cc:654] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:18.049666 15169 log.cc:824] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:18.049665 15168 log.cc:824] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:18.051775 15170 tablet_bootstrap.cc:654] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:18.053340 15170 log.cc:824] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:18.054566 15169 tablet_bootstrap.cc:492] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14: No bootstrap required, opened a new log
I20260808 23:38:18.054569 15168 tablet_bootstrap.cc:492] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260: No bootstrap required, opened a new log
I20260808 23:38:18.054901 15169 ts_tablet_manager.cc:1397] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.008s
I20260808 23:38:18.054940 15168 ts_tablet_manager.cc:1397] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260808 23:38:18.056366 15170 tablet_bootstrap.cc:492] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16: No bootstrap required, opened a new log
I20260808 23:38:18.056723 15170 ts_tablet_manager.cc:1397] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260808 23:38:18.066002 15170 raft_consensus.cc:348] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2abdc4da9bf431681909160a2655e14" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34707 } } peers { permanent_uuid: "21eaed305ff040598ef5a7b7f548eb16" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39145 } } peers { permanent_uuid: "de1dac9472c44d91b40ba1f140799260" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42625 } }
I20260808 23:38:18.066478 15170 raft_consensus.cc:374] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:18.066583 15170 raft_consensus.cc:729] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21eaed305ff040598ef5a7b7f548eb16, State: Initialized, Role: FOLLOWER
I20260808 23:38:18.067044 15168 raft_consensus.cc:348] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2abdc4da9bf431681909160a2655e14" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34707 } } peers { permanent_uuid: "21eaed305ff040598ef5a7b7f548eb16" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39145 } } peers { permanent_uuid: "de1dac9472c44d91b40ba1f140799260" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42625 } }
I20260808 23:38:18.067283 15170 consensus_queue.cc:260] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2abdc4da9bf431681909160a2655e14" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34707 } } peers { permanent_uuid: "21eaed305ff040598ef5a7b7f548eb16" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39145 } } peers { permanent_uuid: "de1dac9472c44d91b40ba1f140799260" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42625 } }
I20260808 23:38:18.067503 15168 raft_consensus.cc:374] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:18.067606 15168 raft_consensus.cc:729] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de1dac9472c44d91b40ba1f140799260, State: Initialized, Role: FOLLOWER
I20260808 23:38:18.067587 15169 raft_consensus.cc:348] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2abdc4da9bf431681909160a2655e14" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34707 } } peers { permanent_uuid: "21eaed305ff040598ef5a7b7f548eb16" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39145 } } peers { permanent_uuid: "de1dac9472c44d91b40ba1f140799260" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42625 } }
I20260808 23:38:18.068042 15169 raft_consensus.cc:374] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:18.068150 15169 raft_consensus.cc:729] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2abdc4da9bf431681909160a2655e14, State: Initialized, Role: FOLLOWER
I20260808 23:38:18.068339 15168 consensus_queue.cc:260] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2abdc4da9bf431681909160a2655e14" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34707 } } peers { permanent_uuid: "21eaed305ff040598ef5a7b7f548eb16" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39145 } } peers { permanent_uuid: "de1dac9472c44d91b40ba1f140799260" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42625 } }
I20260808 23:38:18.068753 15169 consensus_queue.cc:260] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2abdc4da9bf431681909160a2655e14" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34707 } } peers { permanent_uuid: "21eaed305ff040598ef5a7b7f548eb16" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39145 } } peers { permanent_uuid: "de1dac9472c44d91b40ba1f140799260" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42625 } }
I20260808 23:38:18.069304 15149 heartbeater.cc:503] Master 127.26.207.254:40551 was elected leader, sending a full tablet report...
I20260808 23:38:18.069413 15170 ts_tablet_manager.cc:1428] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16: Time spent starting tablet: real 0.013s user 0.010s sys 0.002s
I20260808 23:38:18.070391 15006 heartbeater.cc:503] Master 127.26.207.254:40551 was elected leader, sending a full tablet report...
I20260808 23:38:18.071436 15168 ts_tablet_manager.cc:1428] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260: Time spent starting tablet: real 0.016s user 0.015s sys 0.002s
I20260808 23:38:18.073534 15169 ts_tablet_manager.cc:1428] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14: Time spent starting tablet: real 0.018s user 0.016s sys 0.004s
W20260808 23:38:18.083976 15007 tablet.cc:2369] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:38:18.177472 15150 tablet.cc:2369] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:38:18.211936 15175 raft_consensus.cc:482] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:38:18.212430 15175 raft_consensus.cc:504] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2abdc4da9bf431681909160a2655e14" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34707 } } peers { permanent_uuid: "21eaed305ff040598ef5a7b7f548eb16" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39145 } } peers { permanent_uuid: "de1dac9472c44d91b40ba1f140799260" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42625 } }
I20260808 23:38:18.214541 15175 leader_election.cc:288] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2abdc4da9bf431681909160a2655e14 (127.26.207.193:34707), 21eaed305ff040598ef5a7b7f548eb16 (127.26.207.195:39145)
I20260808 23:38:18.221652 15163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:18.215109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:60153 (local address 127.26.207.193:34707)
0808 23:38:18.215403 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:18.215410 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:18.215792 (+ 382us) server_negotiation.cc:407] Connection header received
0808 23:38:18.216080 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:18.216089 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:18.216205 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:18.216313 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:18.217154 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.217892 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.219770 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.220623 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.220845 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:18.220931 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:18.221228 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 23:38:18.221367 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 23:38:18.221834 15178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:18.214942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:34707 (local address 127.26.207.194:60153)
0808 23:38:18.215654 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:18.215670 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:18.215865 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:18.216441 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:18.216448 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:18.216493 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:18.217000 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:18.217011 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.218034 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.218042 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:18.219592 (+ 1550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:18.219605 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.220884 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.220890 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:18.221050 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:18.221075 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 23:38:18.221202 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 23:38:18.221357 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"spinlock_wait_cycles":18816,"thread_start_us":406,"threads_started":1}
I20260808 23:38:18.221997 15167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:18.216138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:48103 (local address 127.26.207.195:39145)
0808 23:38:18.216374 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:18.216380 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:18.216614 (+ 234us) server_negotiation.cc:407] Connection header received
0808 23:38:18.216873 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:18.216878 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:18.216947 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:18.217048 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:18.217578 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.218317 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.220091 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.220966 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.221179 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:18.221256 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:18.221580 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 23:38:18.221710 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 23:38:18.222221 15179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:18.215836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:39145 (local address 127.26.207.194:48103)
0808 23:38:18.216496 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:18.216510 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:18.216698 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:18.217069 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:18.217073 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:18.217097 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:18.217408 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:18.217416 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.218464 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.218470 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:18.219915 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:18.219926 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.221222 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.221229 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:18.221408 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:18.221431 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 23:38:18.221547 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 23:38:18.221680 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"mutex_wait_us":1,"thread_start_us":328,"threads_started":1}
I20260808 23:38:18.223094 14817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6668ec0f87bf4104ba3877eecbbaf24c" candidate_uuid: "de1dac9472c44d91b40ba1f140799260" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2abdc4da9bf431681909160a2655e14" is_pre_election: true
I20260808 23:38:18.223304 15102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6668ec0f87bf4104ba3877eecbbaf24c" candidate_uuid: "de1dac9472c44d91b40ba1f140799260" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21eaed305ff040598ef5a7b7f548eb16" is_pre_election: true
I20260808 23:38:18.223698 14817 raft_consensus.cc:2454] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de1dac9472c44d91b40ba1f140799260 in term 0.
I20260808 23:38:18.223834 15102 raft_consensus.cc:2454] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de1dac9472c44d91b40ba1f140799260 in term 0.
I20260808 23:38:18.224543 14889 leader_election.cc:302] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c2abdc4da9bf431681909160a2655e14, de1dac9472c44d91b40ba1f140799260; no voters:
I20260808 23:38:18.224994 15175 raft_consensus.cc:2781] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:38:18.225131 15175 raft_consensus.cc:482] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:38:18.225284 15175 raft_consensus.cc:3037] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [term 0 FOLLOWER]: Advancing to term 1
W20260808 23:38:18.226610 14865 tablet.cc:2369] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:38:18.227833 15175 raft_consensus.cc:504] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2abdc4da9bf431681909160a2655e14" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34707 } } peers { permanent_uuid: "21eaed305ff040598ef5a7b7f548eb16" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39145 } } peers { permanent_uuid: "de1dac9472c44d91b40ba1f140799260" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42625 } }
I20260808 23:38:18.228505 15175 leader_election.cc:288] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [CANDIDATE]: Term 1 election: Requested vote from peers c2abdc4da9bf431681909160a2655e14 (127.26.207.193:34707), 21eaed305ff040598ef5a7b7f548eb16 (127.26.207.195:39145)
I20260808 23:38:18.229121 14817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6668ec0f87bf4104ba3877eecbbaf24c" candidate_uuid: "de1dac9472c44d91b40ba1f140799260" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2abdc4da9bf431681909160a2655e14"
I20260808 23:38:18.229220 15102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6668ec0f87bf4104ba3877eecbbaf24c" candidate_uuid: "de1dac9472c44d91b40ba1f140799260" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21eaed305ff040598ef5a7b7f548eb16"
I20260808 23:38:18.229350 14817 raft_consensus.cc:3037] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:18.229501 15102 raft_consensus.cc:3037] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:18.231812 14817 raft_consensus.cc:2454] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de1dac9472c44d91b40ba1f140799260 in term 1.
I20260808 23:38:18.231827 15102 raft_consensus.cc:2454] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de1dac9472c44d91b40ba1f140799260 in term 1.
I20260808 23:38:18.232323 14889 leader_election.cc:302] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c2abdc4da9bf431681909160a2655e14, de1dac9472c44d91b40ba1f140799260; no voters:
I20260808 23:38:18.232684 15175 raft_consensus.cc:2781] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:18.233246 15175 raft_consensus.cc:686] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [term 1 LEADER]: Becoming Leader. State: Replica: de1dac9472c44d91b40ba1f140799260, State: Running, Role: LEADER
I20260808 23:38:18.233781 15175 consensus_queue.cc:237] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2abdc4da9bf431681909160a2655e14" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34707 } } peers { permanent_uuid: "21eaed305ff040598ef5a7b7f548eb16" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39145 } } peers { permanent_uuid: "de1dac9472c44d91b40ba1f140799260" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42625 } }
I20260808 23:38:18.238662 14658 catalog_manager.cc:5495] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 reported cstate change: term changed from 0 to 1, leader changed from <none> to de1dac9472c44d91b40ba1f140799260 (127.26.207.194). New cstate: current_term: 1 leader_uuid: "de1dac9472c44d91b40ba1f140799260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2abdc4da9bf431681909160a2655e14" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21eaed305ff040598ef5a7b7f548eb16" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de1dac9472c44d91b40ba1f140799260" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 42625 } health_report { overall_health: HEALTHY } } }
I20260808 23:38:18.266376 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:18.259769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51414 (local address 127.26.207.194:42625)
0808 23:38:18.260018 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:18.260048 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:18.260102 (+ 54us) server_negotiation.cc:407] Connection header received
0808 23:38:18.260410 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:18.260417 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:18.260511 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:18.260677 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:38:18.261215 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.262076 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.263709 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.264160 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.264306 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:18.265140 (+ 834us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:38:18.265681 (+ 541us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:38:18.265839 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:18.266066 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 23:38:18.266120 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 23:38:18.275420 15102 raft_consensus.cc:1261] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16 [term 1 FOLLOWER]: Refusing update from remote peer de1dac9472c44d91b40ba1f140799260: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:38:18.275470 14817 raft_consensus.cc:1261] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14 [term 1 FOLLOWER]: Refusing update from remote peer de1dac9472c44d91b40ba1f140799260: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:38:18.276556 15180 consensus_queue.cc:1035] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21eaed305ff040598ef5a7b7f548eb16" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 39145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:38:18.277076 15175 consensus_queue.cc:1035] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2abdc4da9bf431681909160a2655e14" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:38:18.289413 15184 mvcc.cc:205] Tried to move back new op lower bound from 7316407493724610560 to 7316407493569409024. Current Snapshot: MvccSnapshot[applied={T|T < 7316407493724610560}]
I20260808 23:38:18.293876 15185 mvcc.cc:205] Tried to move back new op lower bound from 7316407493724610560 to 7316407493569409024. Current Snapshot: MvccSnapshot[applied={T|T < 7316407493724610560}]
I20260808 23:38:18.297101 15186 mvcc.cc:205] Tried to move back new op lower bound from 7316407493724610560 to 7316407493569409024. Current Snapshot: MvccSnapshot[applied={T|T < 7316407493724610560}]
I20260808 23:38:18.307798 14658 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:38:18.308235 14658 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48444:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:38:18.312587 14658 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7720edb83024495399e4ec6824049af7: Sending DeleteTablet for 3 replicas of tablet 6668ec0f87bf4104ba3877eecbbaf24c
I20260808 23:38:18.314193 15081 tablet_service.cc:1514] Processing DeleteTablet for tablet 6668ec0f87bf4104ba3877eecbbaf24c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:18 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:35060
I20260808 23:38:18.314163 14938 tablet_service.cc:1514] Processing DeleteTablet for tablet 6668ec0f87bf4104ba3877eecbbaf24c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:18 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:51400
I20260808 23:38:18.314193 14797 tablet_service.cc:1514] Processing DeleteTablet for tablet 6668ec0f87bf4104ba3877eecbbaf24c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:18 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:33814
I20260808 23:38:18.315564 15195 tablet_replica.cc:330] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16: stopping tablet replica
I20260808 23:38:18.316111 15195 raft_consensus.cc:2229] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:38:18.316725 15195 raft_consensus.cc:2258] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:18.317207 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 14726
I20260808 23:38:18.318214 15193 tablet_replica.cc:330] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260: stopping tablet replica
I20260808 23:38:18.318696 15193 raft_consensus.cc:2229] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:38:18.319661 15193 raft_consensus.cc:2258] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:18.320618 15194 tablet_replica.cc:330] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14: stopping tablet replica
I20260808 23:38:18.321383 15194 raft_consensus.cc:2229] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:38:18.321964 15194 raft_consensus.cc:2258] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:18.323001 15193 ts_tablet_manager.cc:1905] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:18.323216 15195 ts_tablet_manager.cc:1905] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:18.325438 15194 ts_tablet_manager.cc:1905] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:18.330518 15195 ts_tablet_manager.cc:1918] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:18.330722 15195 log.cc:1196] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/6668ec0f87bf4104ba3877eecbbaf24c
I20260808 23:38:18.331259 15193 ts_tablet_manager.cc:1918] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:18.331322 15195 ts_tablet_manager.cc:1939] T 6668ec0f87bf4104ba3877eecbbaf24c P 21eaed305ff040598ef5a7b7f548eb16: Deleting consensus metadata
I20260808 23:38:18.331573 15193 log.cc:1196] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/6668ec0f87bf4104ba3877eecbbaf24c
I20260808 23:38:18.332279 15193 ts_tablet_manager.cc:1939] T 6668ec0f87bf4104ba3877eecbbaf24c P de1dac9472c44d91b40ba1f140799260: Deleting consensus metadata
I20260808 23:38:18.333420 15194 ts_tablet_manager.cc:1918] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:18.333632 15194 log.cc:1196] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/6668ec0f87bf4104ba3877eecbbaf24c
I20260808 23:38:18.333572 14642 catalog_manager.cc:4841] TS 21eaed305ff040598ef5a7b7f548eb16 (127.26.207.195:39145): tablet 6668ec0f87bf4104ba3877eecbbaf24c (table test-table [id=35bec73676a8432980883de36b6ca749]) successfully deleted
I20260808 23:38:18.334347 14643 catalog_manager.cc:4841] TS de1dac9472c44d91b40ba1f140799260 (127.26.207.194:42625): tablet 6668ec0f87bf4104ba3877eecbbaf24c (table test-table [id=35bec73676a8432980883de36b6ca749]) successfully deleted
I20260808 23:38:18.334807 15194 ts_tablet_manager.cc:1939] T 6668ec0f87bf4104ba3877eecbbaf24c P c2abdc4da9bf431681909160a2655e14: Deleting consensus metadata
I20260808 23:38:18.336946 14642 catalog_manager.cc:4841] TS c2abdc4da9bf431681909160a2655e14 (127.26.207.193:34707): tablet 6668ec0f87bf4104ba3877eecbbaf24c (table test-table [id=35bec73676a8432980883de36b6ca749]) successfully deleted
Aug 08 23:38:18 dist-test-slave-1x4g krb5kdc[14611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:38:18.352361 15163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:18.318394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33830 (local address 127.26.207.193:34707)
0808 23:38:18.318587 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:18.318594 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:18.319883 (+ 1289us) server_negotiation.cc:407] Connection header received
0808 23:38:18.320240 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:18.320247 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:18.320351 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:18.320440 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:18.322434 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.323961 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.335681 (+ 11720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.336399 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.336584 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:18.342905 (+ 6321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:18.342928 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:18.342975 (+ 47us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:18.343030 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:18.348467 (+ 5437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:18.349747 (+ 1280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:18.349759 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:18.349763 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:18.349942 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:18.350443 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:18.350449 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:18.350452 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:18.350990 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:18.351299 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:18.351708 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 23:38:18.351968 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 23:38:18.353276 14858 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:18.470052 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 14726
I20260808 23:38:18.492506 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 14870
Aug 08 23:38:18 dist-test-slave-1x4g krb5kdc[14611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:38:18.510190 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:18.493432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51420 (local address 127.26.207.194:42625)
0808 23:38:18.493622 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:18.493629 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:18.493700 (+ 71us) server_negotiation.cc:407] Connection header received
0808 23:38:18.493913 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:18.493919 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:18.494012 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:18.494129 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:18.495586 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.496437 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.497872 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.498349 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.498497 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:18.503292 (+ 4795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:18.503309 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:18.503327 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:18.503372 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:18.506839 (+ 3467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:18.507651 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:18.507663 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:18.507665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:18.507872 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:18.508288 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:18.508293 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:18.508297 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:18.508713 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:18.509153 (+ 440us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:18.509505 (+ 352us) server_negotiation.cc:299] Negotiation successful
0808 23:38:18.509761 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 23:38:18.510999 15001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:18.633494 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 14870
I20260808 23:38:18.657052 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 15012
Aug 08 23:38:18 dist-test-slave-1x4g krb5kdc[14611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:38:18.674676 15167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:18.657862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35062 (local address 127.26.207.195:39145)
0808 23:38:18.658060 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:18.658065 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:18.658084 (+ 19us) server_negotiation.cc:407] Connection header received
0808 23:38:18.658250 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:18.658254 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:18.658349 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:18.658454 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:18.659987 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.660761 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.662362 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:18.662801 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:18.662915 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:18.668541 (+ 5626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:18.668564 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:18.668582 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:18.668633 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:18.671818 (+ 3185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:18.672628 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:18.672636 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:18.672638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:18.672891 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:18.673289 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:18.673293 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:18.673295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:18.673679 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:18.673904 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:18.674207 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 23:38:18.674391 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 23:38:18.675366 15143 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:18.769003 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 15012
I20260808 23:38:18.791270 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 14624
I20260808 23:38:18.792474 14693 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:18.913283 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 14624
2026-08-08T23:38:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (5036 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T23:38:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:18Z Disabled control of system clock
I20260808 23:38:19.020838 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:44775
--webserver_interface=127.26.207.254
--webserver_port=0
--builtin_ntp_servers=127.26.207.212:39091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:44775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 23:38:19.399840 15204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:19.400198 15204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:19.400367 15204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:19.408270 15204 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:19.408442 15204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:19.408519 15204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:19.408633 15204 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:19.408720 15204 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:19.418865 15204 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:39091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:44775
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:44775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:19.420365 15204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:19.422358 15204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:19.435369 15210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:19.435459 15214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:19.435422 15211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:19.436540 15204 server_base.cc:1034] running on GCE node
I20260808 23:38:19.437588 15204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:19.439258 15204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:19.440521 15204 hybrid_clock.cc:648] HybridClock initialized: now 1786232299440479 us; error 55 us; skew 500 ppm
I20260808 23:38:19.441002 15204 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:38:19.443638 15204 webserver.cc:460] Webserver started at http://127.26.207.254:36541/ using document root <none> and password file <none>
I20260808 23:38:19.444437 15204 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:19.444593 15204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:19.445019 15204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:19.448164 15204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "925b4c9e26a642d2a7120fed8af093b0"
format_stamp: "Formatted at 2026-08-08 23:38:19 on dist-test-slave-1x4g"
server_key: "9a6bb83e856f28c4800534bd4257a706"
server_key_iv: "a1d03361f48ae8be2e1946e32cc9cb89"
server_key_version: "encryptionkey@0"
I20260808 23:38:19.449170 15204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "925b4c9e26a642d2a7120fed8af093b0"
format_stamp: "Formatted at 2026-08-08 23:38:19 on dist-test-slave-1x4g"
server_key: "9a6bb83e856f28c4800534bd4257a706"
server_key_iv: "a1d03361f48ae8be2e1946e32cc9cb89"
server_key_version: "encryptionkey@0"
I20260808 23:38:19.454802 15204 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 23:38:19.458774 15220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:19.460283 15204 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 23:38:19.460521 15204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "925b4c9e26a642d2a7120fed8af093b0"
format_stamp: "Formatted at 2026-08-08 23:38:19 on dist-test-slave-1x4g"
server_key: "9a6bb83e856f28c4800534bd4257a706"
server_key_iv: "a1d03361f48ae8be2e1946e32cc9cb89"
server_key_version: "encryptionkey@0"
I20260808 23:38:19.460783 15204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:19.474509 15204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:19.475461 15204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:19.475785 15204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:19.495306 15204 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:44775
I20260808 23:38:19.495332 15273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:44775 every 8 connection(s)
I20260808 23:38:19.496858 15204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:19.501128 15274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:19.506407 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 15204
I20260808 23:38:19.506615 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:19.507233 27455 external_mini_cluster.cc:1428] Setting key b0419214af4502eeaa2f1e97687d8d2c
I20260808 23:38:19.514053 15274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0: Bootstrap starting.
I20260808 23:38:19.518108 15274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:19.519526 15274 log.cc:824] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:19.523161 15277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:19.509513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50838 (local address 127.26.207.254:44775)
0808 23:38:19.510651 (+ 1138us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:19.510663 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:19.510710 (+ 47us) server_negotiation.cc:407] Connection header received
0808 23:38:19.512565 (+ 1855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:19.512591 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:19.513190 (+ 599us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:19.513564 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:19.514380 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:19.515792 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:19.517954 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:19.518809 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:19.519041 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:19.520441 (+ 1400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:19.520457 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:19.520483 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:19.521329 (+ 846us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:19.521423 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:19.521447 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:19.521548 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:19.521797 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 23:38:19.522173 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":407,"threads_started":1}
I20260808 23:38:19.523372 15274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0: No bootstrap required, opened a new log
I20260808 23:38:19.531831 15274 raft_consensus.cc:348] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925b4c9e26a642d2a7120fed8af093b0" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44775 } }
I20260808 23:38:19.532296 15274 raft_consensus.cc:374] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:19.532433 15274 raft_consensus.cc:729] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925b4c9e26a642d2a7120fed8af093b0, State: Initialized, Role: FOLLOWER
I20260808 23:38:19.533215 15274 consensus_queue.cc:260] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925b4c9e26a642d2a7120fed8af093b0" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44775 } }
I20260808 23:38:19.533461 15274 raft_consensus.cc:388] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:19.533574 15274 raft_consensus.cc:482] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:19.533720 15274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:19.535974 15274 raft_consensus.cc:504] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925b4c9e26a642d2a7120fed8af093b0" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44775 } }
I20260808 23:38:19.536484 15274 leader_election.cc:302] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 925b4c9e26a642d2a7120fed8af093b0; no voters:
I20260808 23:38:19.537201 15274 leader_election.cc:288] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:19.537397 15279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:19.538199 15279 raft_consensus.cc:686] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [term 1 LEADER]: Becoming Leader. State: Replica: 925b4c9e26a642d2a7120fed8af093b0, State: Running, Role: LEADER
I20260808 23:38:19.538802 15279 consensus_queue.cc:237] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925b4c9e26a642d2a7120fed8af093b0" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44775 } }
I20260808 23:38:19.539741 15274 sys_catalog.cc:564] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:19.542392 15280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "925b4c9e26a642d2a7120fed8af093b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925b4c9e26a642d2a7120fed8af093b0" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44775 } } }
I20260808 23:38:19.542228 15281 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 925b4c9e26a642d2a7120fed8af093b0. Latest consensus state: current_term: 1 leader_uuid: "925b4c9e26a642d2a7120fed8af093b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925b4c9e26a642d2a7120fed8af093b0" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44775 } } }
I20260808 23:38:19.542770 15280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:19.542807 15281 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:19.545075 15290 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:19.550640 15290 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:19.560945 15290 catalog_manager.cc:1347] Generated new cluster ID: 1aa929f6f7c8412c9ebf6aa4c5b96dcd
I20260808 23:38:19.561107 15290 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:19.605535 15290 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:19.607291 15290 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:19.615231 15290 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0: Generated new TSK 0
I20260808 23:38:19.616688 15290 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:38:19.626060 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:44775
--builtin_ntp_servers=127.26.207.212:39091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 23:38:20.030427 15300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:20.030756 15300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:20.030936 15300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:20.038851 15300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:20.038986 15300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:20.039198 15300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:38:20.049597 15300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:39091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:44775
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:20.051077 15300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:20.053072 15300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:20.068058 15306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:20.068099 15308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:20.068121 15305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:20.074767 15300 server_base.cc:1034] running on GCE node
I20260808 23:38:20.075623 15300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:20.076959 15300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:20.078233 15300 hybrid_clock.cc:648] HybridClock initialized: now 1786232300078185 us; error 51 us; skew 500 ppm
I20260808 23:38:20.078626 15300 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:38:20.081398 15300 webserver.cc:460] Webserver started at http://127.26.207.193:42127/ using document root <none> and password file <none>
I20260808 23:38:20.082231 15300 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:20.082388 15300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:20.082763 15300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:20.086283 15300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "308fe1daa1a14721b860d0615f9e0c8a"
format_stamp: "Formatted at 2026-08-08 23:38:20 on dist-test-slave-1x4g"
server_key: "407624186977dbc88852988df6d3008d"
server_key_iv: "09a6afc137ab2f090c38aa4f70f53cd0"
server_key_version: "encryptionkey@0"
I20260808 23:38:20.087275 15300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "308fe1daa1a14721b860d0615f9e0c8a"
format_stamp: "Formatted at 2026-08-08 23:38:20 on dist-test-slave-1x4g"
server_key: "407624186977dbc88852988df6d3008d"
server_key_iv: "09a6afc137ab2f090c38aa4f70f53cd0"
server_key_version: "encryptionkey@0"
I20260808 23:38:20.094020 15300 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260808 23:38:20.098798 15314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:20.100698 15300 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 23:38:20.101042 15300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "308fe1daa1a14721b860d0615f9e0c8a"
format_stamp: "Formatted at 2026-08-08 23:38:20 on dist-test-slave-1x4g"
server_key: "407624186977dbc88852988df6d3008d"
server_key_iv: "09a6afc137ab2f090c38aa4f70f53cd0"
server_key_version: "encryptionkey@0"
I20260808 23:38:20.101346 15300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:20.125031 15300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:20.125993 15300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:20.126350 15300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:20.127456 15300 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:20.129222 15300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:20.129359 15300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:20.129506 15300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:20.129599 15300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:20.169616 15300 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:33255
I20260808 23:38:20.169675 15434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:33255 every 8 connection(s)
I20260808 23:38:20.171196 15300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:38:20.181250 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 15300
I20260808 23:38:20.181481 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:38:20.181950 27455 external_mini_cluster.cc:1428] Setting key 6a5c0e32435df1e2a278b2a7dcf92aa7
I20260808 23:38:20.185708 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:44775
--builtin_ntp_servers=127.26.207.212:39091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 23:38:20.187974 15437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:20.174532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:40763 (local address 127.26.207.254:44775)
0808 23:38:20.175265 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:20.175272 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:20.176534 (+ 1262us) server_negotiation.cc:407] Connection header received
0808 23:38:20.178675 (+ 2141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:20.178680 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:20.178776 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:20.178894 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:20.180317 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:20.181249 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:20.183569 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:20.184198 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:20.184366 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:20.186652 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:20.186663 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:20.186674 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:20.186708 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:20.186774 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:20.186796 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:20.186929 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:20.187313 (+ 384us) server_negotiation.cc:299] Negotiation successful
0808 23:38:20.187470 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":434,"threads_started":1}
I20260808 23:38:20.189146 15439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:20.174976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:44775 (local address 127.26.207.193:40763)
0808 23:38:20.176267 (+ 1291us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:20.176325 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:20.178327 (+ 2002us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:20.179200 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:20.179210 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:20.179316 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:20.180073 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:20.180098 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:20.181535 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:20.181540 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:20.183353 (+ 1813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:20.183376 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:20.184590 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:20.184601 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:20.184955 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:20.186011 (+ 1056us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:38:20.186016 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:20.186117 (+ 101us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:38:20.186296 (+ 179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:20.187008 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:20.187030 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:20.187040 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 23:38:20.187266 (+ 226us) client_negotiation.cc:240] Negotiation successful
0808 23:38:20.187702 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":432,"threads_started":1}
I20260808 23:38:20.191172 15435 heartbeater.cc:347] Connected to a master server at 127.26.207.254:44775
I20260808 23:38:20.191601 15435 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:20.192488 15435 heartbeater.cc:511] Master 127.26.207.254:44775 requested a full tablet report, sending...
I20260808 23:38:20.195187 15237 ts_manager.cc:194] Registered new tserver with Master: 308fe1daa1a14721b860d0615f9e0c8a (127.26.207.193:33255)
I20260808 23:38:20.196990 15237 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.207.193:40763
W20260808 23:38:20.573869 15440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:20.574237 15440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:20.574348 15440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:20.582152 15440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:20.582280 15440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:20.582396 15440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:38:20.591971 15440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:39091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:44775
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:20.593402 15440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:20.595283 15440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:20.609843 15446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:20.609815 15449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:20.609881 15447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:20.610868 15440 server_base.cc:1034] running on GCE node
I20260808 23:38:20.611630 15440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:20.612871 15440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:20.614145 15440 hybrid_clock.cc:648] HybridClock initialized: now 1786232300614071 us; error 68 us; skew 500 ppm
I20260808 23:38:20.614532 15440 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:38:20.617498 15440 webserver.cc:460] Webserver started at http://127.26.207.194:41229/ using document root <none> and password file <none>
I20260808 23:38:20.618865 15440 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:20.619133 15440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:20.619578 15440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:20.622970 15440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "1b20e2b77f314b4abd9d1c2cda2afa49"
format_stamp: "Formatted at 2026-08-08 23:38:20 on dist-test-slave-1x4g"
server_key: "519eec5a380fc35becf23ae8679bfba1"
server_key_iv: "26d94ba142d30e90593f209490d47ded"
server_key_version: "encryptionkey@0"
I20260808 23:38:20.623880 15440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "1b20e2b77f314b4abd9d1c2cda2afa49"
format_stamp: "Formatted at 2026-08-08 23:38:20 on dist-test-slave-1x4g"
server_key: "519eec5a380fc35becf23ae8679bfba1"
server_key_iv: "26d94ba142d30e90593f209490d47ded"
server_key_version: "encryptionkey@0"
I20260808 23:38:20.630057 15440 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 23:38:20.634428 15455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:20.636070 15440 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260808 23:38:20.636298 15440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "1b20e2b77f314b4abd9d1c2cda2afa49"
format_stamp: "Formatted at 2026-08-08 23:38:20 on dist-test-slave-1x4g"
server_key: "519eec5a380fc35becf23ae8679bfba1"
server_key_iv: "26d94ba142d30e90593f209490d47ded"
server_key_version: "encryptionkey@0"
I20260808 23:38:20.636562 15440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:20.671919 15440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:20.672955 15440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:20.673295 15440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:20.674391 15440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:20.676121 15440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:20.676267 15440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:20.676399 15440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:20.676492 15440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:20.713552 15440 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:33701
I20260808 23:38:20.713671 15572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:33701 every 8 connection(s)
I20260808 23:38:20.715090 15440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:38:20.725263 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 15440
I20260808 23:38:20.725482 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:38:20.725957 27455 external_mini_cluster.cc:1428] Setting key 7bb4c6701225e971c6d810c24db1d18b
I20260808 23:38:20.729019 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:44775
--builtin_ntp_servers=127.26.207.212:39091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 23:38:20.729465 15575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:20.718214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:57065 (local address 127.26.207.254:44775)
0808 23:38:20.718768 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:20.718774 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:20.720008 (+ 1234us) server_negotiation.cc:407] Connection header received
0808 23:38:20.722029 (+ 2021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:20.722035 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:20.722140 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:20.722273 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:20.723508 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:20.724270 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:20.726242 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:20.726688 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:20.726849 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:20.728426 (+ 1577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:20.728440 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:20.728443 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:20.728462 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:20.728505 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:20.728518 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:20.728630 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:20.728947 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 23:38:20.729067 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":311,"threads_started":1}
I20260808 23:38:20.730674 15576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:20.718741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:44775 (local address 127.26.207.194:57065)
0808 23:38:20.719808 (+ 1067us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:20.719850 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:20.721702 (+ 1852us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:20.722551 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:20.722562 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:20.722672 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:20.723309 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:20.723327 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:20.724455 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:20.724462 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:20.726031 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:20.726046 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:20.726951 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:20.726961 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:20.727236 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:20.728045 (+ 809us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:38:20.728047 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:20.728093 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:38:20.728196 (+ 103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:20.728636 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:20.728651 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:20.728662 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 23:38:20.728934 (+ 272us) client_negotiation.cc:240] Negotiation successful
0808 23:38:20.729424 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":343,"threads_started":1}
I20260808 23:38:20.732672 15573 heartbeater.cc:347] Connected to a master server at 127.26.207.254:44775
I20260808 23:38:20.733080 15573 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:20.733940 15573 heartbeater.cc:511] Master 127.26.207.254:44775 requested a full tablet report, sending...
I20260808 23:38:20.735786 15237 ts_manager.cc:194] Registered new tserver with Master: 1b20e2b77f314b4abd9d1c2cda2afa49 (127.26.207.194:33701)
I20260808 23:38:20.737121 15237 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.207.194:57065
W20260808 23:38:21.118024 15578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:21.118347 15578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:21.118517 15578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:21.126072 15578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:21.126194 15578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:21.126384 15578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:38:21.136057 15578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:39091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:44775
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:21.137553 15578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:21.139499 15578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:21.154170 15583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:21.154273 15586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:21.154214 15584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:21.155138 15578 server_base.cc:1034] running on GCE node
I20260808 23:38:21.155860 15578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:21.157047 15578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:21.158332 15578 hybrid_clock.cc:648] HybridClock initialized: now 1786232301158257 us; error 69 us; skew 500 ppm
I20260808 23:38:21.158761 15578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:38:21.166800 15578 webserver.cc:460] Webserver started at http://127.26.207.195:36215/ using document root <none> and password file <none>
I20260808 23:38:21.167853 15578 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:21.168079 15578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:21.168474 15578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:21.171926 15578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "f461775876f74956a3b07e76420692db"
format_stamp: "Formatted at 2026-08-08 23:38:21 on dist-test-slave-1x4g"
server_key: "34a4859371f6d4c2c6f9ddef3fb410d4"
server_key_iv: "001fc165a528c6ed6999d7fcc5b2452e"
server_key_version: "encryptionkey@0"
I20260808 23:38:21.173019 15578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "f461775876f74956a3b07e76420692db"
format_stamp: "Formatted at 2026-08-08 23:38:21 on dist-test-slave-1x4g"
server_key: "34a4859371f6d4c2c6f9ddef3fb410d4"
server_key_iv: "001fc165a528c6ed6999d7fcc5b2452e"
server_key_version: "encryptionkey@0"
I20260808 23:38:21.179279 15578 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 23:38:21.184046 15593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:21.186208 15578 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260808 23:38:21.186480 15578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "f461775876f74956a3b07e76420692db"
format_stamp: "Formatted at 2026-08-08 23:38:21 on dist-test-slave-1x4g"
server_key: "34a4859371f6d4c2c6f9ddef3fb410d4"
server_key_iv: "001fc165a528c6ed6999d7fcc5b2452e"
server_key_version: "encryptionkey@0"
I20260808 23:38:21.186789 15578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:21.200718 15435 heartbeater.cc:503] Master 127.26.207.254:44775 was elected leader, sending a full tablet report...
I20260808 23:38:21.209200 15578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:21.210176 15578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:21.210536 15578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:21.211890 15578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:21.213802 15578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:21.213948 15578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:21.214095 15578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:21.214190 15578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:21.255309 15578 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:36231
I20260808 23:38:21.255342 15711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:36231 every 8 connection(s)
I20260808 23:38:21.256992 15578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:38:21.257790 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 15578
I20260808 23:38:21.258015 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:38:21.258687 27455 external_mini_cluster.cc:1428] Setting key 1e8eafb95bdcfee8ecd3f7c5159e3afe
I20260808 23:38:21.272450 15714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:21.260501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:37511 (local address 127.26.207.254:44775)
0808 23:38:21.261103 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:21.261111 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:21.262781 (+ 1670us) server_negotiation.cc:407] Connection header received
0808 23:38:21.264916 (+ 2135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:21.264922 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:21.265044 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:21.265229 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:21.266621 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.267398 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.269245 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.269675 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.269825 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:21.271456 (+ 1631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:21.271461 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:21.271465 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:21.271489 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:21.271536 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:21.271548 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:21.271655 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:21.271907 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 23:38:21.272036 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":296,"threads_started":1}
I20260808 23:38:21.274004 15715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:21.261323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:44775 (local address 127.26.207.195:37511)
0808 23:38:21.262574 (+ 1251us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:21.262636 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:21.264510 (+ 1874us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:21.265565 (+ 1055us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:21.265575 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:21.265686 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:21.266409 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:21.266430 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.267583 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.267587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:21.269068 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:21.269084 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.269962 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.269972 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:21.270227 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:21.271050 (+ 823us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:38:21.271053 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:21.271102 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:38:21.271208 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:21.271657 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:21.271671 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:21.271682 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 23:38:21.271894 (+ 212us) client_negotiation.cc:240] Negotiation successful
0808 23:38:21.272448 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":413,"threads_started":1}
I20260808 23:38:21.275723 15712 heartbeater.cc:347] Connected to a master server at 127.26.207.254:44775
I20260808 23:38:21.276130 15712 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:21.277184 15712 heartbeater.cc:511] Master 127.26.207.254:44775 requested a full tablet report, sending...
I20260808 23:38:21.279129 15236 ts_manager.cc:194] Registered new tserver with Master: f461775876f74956a3b07e76420692db (127.26.207.195:36231)
I20260808 23:38:21.280172 15236 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.207.195:37511
I20260808 23:38:21.288755 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:38:21.301862 15714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:21.294321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50846 (local address 127.26.207.254:44775)
0808 23:38:21.294648 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:21.294657 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:21.294984 (+ 327us) server_negotiation.cc:407] Connection header received
0808 23:38:21.295248 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:21.295254 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:21.295328 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:21.295465 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:21.296077 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.296964 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.298691 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.299205 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.299368 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:21.300886 (+ 1518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:21.300891 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:21.300895 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:21.300925 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:21.300964 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:21.300977 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:21.301169 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:21.301395 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 23:38:21.301462 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260808 23:38:21.308363 15236 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50846:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:38:21.317927 15236 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:38:21.347357 15729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:21.334661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34258 (local address 127.26.207.195:36231)
0808 23:38:21.337276 (+ 2615us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:21.337287 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:21.337319 (+ 32us) server_negotiation.cc:407] Connection header received
0808 23:38:21.337444 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:21.337453 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:21.337744 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:21.338894 (+ 1150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:21.339195 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.340998 (+ 1803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.344339 (+ 3341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.346002 (+ 1663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.346235 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:21.346525 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:21.346791 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 23:38:21.346993 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2399,"thread_start_us":2238,"threads_started":1}
I20260808 23:38:21.347378 15728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:21.334509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:36231 (local address 127.0.0.1:34258)
0808 23:38:21.335819 (+ 1310us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:21.335862 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:21.336050 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:21.338020 (+ 1970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:21.338028 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:21.338069 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:21.338610 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:21.338626 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.341168 (+ 2542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.341173 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:21.344096 (+ 2923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:21.344114 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.346239 (+ 2125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.346251 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:21.346499 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:21.346565 (+ 66us) client_negotiation.cc:769] Sending connection context
0808 23:38:21.346726 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 23:38:21.346973 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1029,"mutex_wait_us":88,"thread_start_us":2373,"threads_started":1}
I20260808 23:38:21.348958 15730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:21.335215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52216 (local address 127.26.207.194:33701)
0808 23:38:21.336653 (+ 1438us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:21.336663 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:21.337328 (+ 665us) server_negotiation.cc:407] Connection header received
0808 23:38:21.337638 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:21.337645 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:21.337830 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:21.338024 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:21.339114 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.340726 (+ 1612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.344739 (+ 4013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.346227 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.346385 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:21.346553 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:21.348335 (+ 1782us) server_negotiation.cc:299] Negotiation successful
0808 23:38:21.348555 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1237,"thread_start_us":1089,"threads_started":1}
I20260808 23:38:21.349704 15727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:21.334610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:33701 (local address 127.0.0.1:52216)
0808 23:38:21.337197 (+ 2587us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:21.337219 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:21.337445 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:21.338367 (+ 922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:21.338372 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:21.338404 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:21.338910 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:21.338923 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.340963 (+ 2040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.340969 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:21.344445 (+ 3476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:21.344462 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.346729 (+ 2267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.346735 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:21.346933 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:21.346967 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 23:38:21.349182 (+ 2215us) client_negotiation.cc:240] Negotiation successful
0808 23:38:21.349351 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2455,"mutex_wait_us":60,"thread_start_us":762,"threads_started":1}
I20260808 23:38:21.350939 15731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:21.337364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:33255 (local address 127.0.0.1:58558)
0808 23:38:21.341965 (+ 4601us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:21.341992 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:21.342119 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:21.343203 (+ 1084us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:21.343207 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:21.343233 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:21.344067 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:21.344080 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.345804 (+ 1724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.345809 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:21.348020 (+ 2211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:21.348038 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.350163 (+ 2125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.350170 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:21.350350 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:21.350383 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 23:38:21.350488 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 23:38:21.350634 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4444,"thread_start_us":4259,"threads_started":1}
I20260808 23:38:21.351102 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:21.338383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58558 (local address 127.26.207.193:33255)
0808 23:38:21.342464 (+ 4081us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:21.342473 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:21.342507 (+ 34us) server_negotiation.cc:407] Connection header received
0808 23:38:21.342625 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:21.342636 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:21.342941 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:21.343509 (+ 568us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:21.344369 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.345636 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.348294 (+ 2658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.349929 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.350149 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:21.350388 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:21.350554 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 23:38:21.350727 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3892,"thread_start_us":3736,"threads_started":1}
I20260808 23:38:21.355602 15365 tablet_service.cc:1467] Processing CreateTablet for tablet 9d7a43495fdf46da91f5d96a18bd839f (DEFAULT_TABLE table=test-table [id=034d198158ec471e9362ba2d0e0c8b73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:21.361760 15365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d7a43495fdf46da91f5d96a18bd839f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:21.364593 15506 tablet_service.cc:1467] Processing CreateTablet for tablet 9d7a43495fdf46da91f5d96a18bd839f (DEFAULT_TABLE table=test-table [id=034d198158ec471e9362ba2d0e0c8b73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:21.367080 15506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d7a43495fdf46da91f5d96a18bd839f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:21.368819 15643 tablet_service.cc:1467] Processing CreateTablet for tablet 9d7a43495fdf46da91f5d96a18bd839f (DEFAULT_TABLE table=test-table [id=034d198158ec471e9362ba2d0e0c8b73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:21.371174 15643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d7a43495fdf46da91f5d96a18bd839f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:21.385183 15733 tablet_bootstrap.cc:492] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a: Bootstrap starting.
I20260808 23:38:21.389631 15734 tablet_bootstrap.cc:492] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49: Bootstrap starting.
I20260808 23:38:21.394081 15734 tablet_bootstrap.cc:654] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:21.394081 15733 tablet_bootstrap.cc:654] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:21.395741 15734 log.cc:824] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:21.396263 15733 log.cc:824] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:21.397692 15735 tablet_bootstrap.cc:492] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db: Bootstrap starting.
I20260808 23:38:21.402082 15735 tablet_bootstrap.cc:654] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:21.403784 15735 log.cc:824] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:21.404150 15733 tablet_bootstrap.cc:492] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a: No bootstrap required, opened a new log
I20260808 23:38:21.404176 15734 tablet_bootstrap.cc:492] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49: No bootstrap required, opened a new log
I20260808 23:38:21.404618 15733 ts_tablet_manager.cc:1397] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.000s
I20260808 23:38:21.405001 15734 ts_tablet_manager.cc:1397] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.003s
I20260808 23:38:21.417567 15735 tablet_bootstrap.cc:492] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db: No bootstrap required, opened a new log
I20260808 23:38:21.418442 15735 ts_tablet_manager.cc:1397] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db: Time spent bootstrapping tablet: real 0.021s user 0.012s sys 0.004s
I20260808 23:38:21.420642 15733 raft_consensus.cc:348] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f461775876f74956a3b07e76420692db" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36231 } } peers { permanent_uuid: "1b20e2b77f314b4abd9d1c2cda2afa49" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33701 } } peers { permanent_uuid: "308fe1daa1a14721b860d0615f9e0c8a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33255 } }
I20260808 23:38:21.421010 15734 raft_consensus.cc:348] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f461775876f74956a3b07e76420692db" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36231 } } peers { permanent_uuid: "1b20e2b77f314b4abd9d1c2cda2afa49" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33701 } } peers { permanent_uuid: "308fe1daa1a14721b860d0615f9e0c8a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33255 } }
I20260808 23:38:21.421463 15733 raft_consensus.cc:374] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:21.421599 15734 raft_consensus.cc:374] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:21.421643 15733 raft_consensus.cc:729] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308fe1daa1a14721b860d0615f9e0c8a, State: Initialized, Role: FOLLOWER
I20260808 23:38:21.421756 15734 raft_consensus.cc:729] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b20e2b77f314b4abd9d1c2cda2afa49, State: Initialized, Role: FOLLOWER
I20260808 23:38:21.422575 15734 consensus_queue.cc:260] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f461775876f74956a3b07e76420692db" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36231 } } peers { permanent_uuid: "1b20e2b77f314b4abd9d1c2cda2afa49" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33701 } } peers { permanent_uuid: "308fe1daa1a14721b860d0615f9e0c8a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33255 } }
I20260808 23:38:21.422583 15733 consensus_queue.cc:260] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f461775876f74956a3b07e76420692db" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36231 } } peers { permanent_uuid: "1b20e2b77f314b4abd9d1c2cda2afa49" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33701 } } peers { permanent_uuid: "308fe1daa1a14721b860d0615f9e0c8a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33255 } }
I20260808 23:38:21.433975 15573 heartbeater.cc:503] Master 127.26.207.254:44775 was elected leader, sending a full tablet report...
I20260808 23:38:21.434681 15733 ts_tablet_manager.cc:1428] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a: Time spent starting tablet: real 0.030s user 0.013s sys 0.015s
I20260808 23:38:21.434690 15734 ts_tablet_manager.cc:1428] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49: Time spent starting tablet: real 0.029s user 0.008s sys 0.019s
I20260808 23:38:21.435948 15735 raft_consensus.cc:348] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f461775876f74956a3b07e76420692db" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36231 } } peers { permanent_uuid: "1b20e2b77f314b4abd9d1c2cda2afa49" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33701 } } peers { permanent_uuid: "308fe1daa1a14721b860d0615f9e0c8a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33255 } }
I20260808 23:38:21.437325 15735 raft_consensus.cc:374] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:21.437536 15735 raft_consensus.cc:729] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f461775876f74956a3b07e76420692db, State: Initialized, Role: FOLLOWER
I20260808 23:38:21.438534 15735 consensus_queue.cc:260] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f461775876f74956a3b07e76420692db" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36231 } } peers { permanent_uuid: "1b20e2b77f314b4abd9d1c2cda2afa49" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33701 } } peers { permanent_uuid: "308fe1daa1a14721b860d0615f9e0c8a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33255 } }
I20260808 23:38:21.442860 15712 heartbeater.cc:503] Master 127.26.207.254:44775 was elected leader, sending a full tablet report...
I20260808 23:38:21.444041 15735 ts_tablet_manager.cc:1428] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db: Time spent starting tablet: real 0.025s user 0.015s sys 0.008s
W20260808 23:38:21.467694 15574 tablet.cc:2369] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:38:21.509402 15713 tablet.cc:2369] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:38:21.575537 15739 raft_consensus.cc:482] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:38:21.576017 15739 raft_consensus.cc:504] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f461775876f74956a3b07e76420692db" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36231 } } peers { permanent_uuid: "1b20e2b77f314b4abd9d1c2cda2afa49" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33701 } } peers { permanent_uuid: "308fe1daa1a14721b860d0615f9e0c8a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33255 } }
I20260808 23:38:21.578634 15739 leader_election.cc:288] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f461775876f74956a3b07e76420692db (127.26.207.195:36231), 308fe1daa1a14721b860d0615f9e0c8a (127.26.207.193:33255)
I20260808 23:38:21.588310 15729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:21.579341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:52263 (local address 127.26.207.195:36231)
0808 23:38:21.579593 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:21.579602 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:21.579996 (+ 394us) server_negotiation.cc:407] Connection header received
0808 23:38:21.580341 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:21.580348 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:21.580449 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:21.580526 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:21.581494 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.582694 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.585619 (+ 2925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.586984 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.587167 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:21.587240 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:21.587844 (+ 604us) server_negotiation.cc:299] Negotiation successful
0808 23:38:21.588015 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 23:38:21.588696 15742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:21.578990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:36231 (local address 127.26.207.194:52263)
0808 23:38:21.579853 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:21.579875 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:21.580143 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:21.580752 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:21.580758 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:21.580819 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:21.581271 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:21.581291 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.582907 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.582912 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:21.585365 (+ 2453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:21.585380 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.587250 (+ 1870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.587260 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:21.587520 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:21.587656 (+ 136us) client_negotiation.cc:769] Sending connection context
0808 23:38:21.587789 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 23:38:21.588123 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"mutex_wait_us":153,"thread_start_us":610,"threads_started":1}
I20260808 23:38:21.590340 15663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d7a43495fdf46da91f5d96a18bd839f" candidate_uuid: "1b20e2b77f314b4abd9d1c2cda2afa49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f461775876f74956a3b07e76420692db" is_pre_election: true
I20260808 23:38:21.591154 15663 raft_consensus.cc:2454] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b20e2b77f314b4abd9d1c2cda2afa49 in term 0.
I20260808 23:38:21.592065 15459 leader_election.cc:302] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b20e2b77f314b4abd9d1c2cda2afa49, f461775876f74956a3b07e76420692db; no voters:
I20260808 23:38:21.592279 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:21.580609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:54435 (local address 127.26.207.193:33255)
0808 23:38:21.580887 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:21.580895 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:21.584845 (+ 3950us) server_negotiation.cc:407] Connection header received
0808 23:38:21.585148 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:21.585154 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:21.585265 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:21.585336 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:21.586264 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.587368 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.589970 (+ 2602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.591135 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.591325 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:21.591402 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:21.591862 (+ 460us) server_negotiation.cc:299] Negotiation successful
0808 23:38:21.592004 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 23:38:21.592487 15743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:21.580131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:33255 (local address 127.26.207.194:54435)
0808 23:38:21.584690 (+ 4559us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:21.584713 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:21.584980 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:21.585574 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:21.585579 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:21.585609 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:21.586043 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:21.586055 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.587522 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.587527 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:21.589741 (+ 2214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:21.589760 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.591347 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.591356 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:21.591637 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:21.591678 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 23:38:21.591834 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 23:38:21.592009 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4401,"mutex_wait_us":3,"thread_start_us":5832,"threads_started":1}
I20260808 23:38:21.592670 15739 raft_consensus.cc:2781] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:38:21.592887 15739 raft_consensus.cc:482] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:38:21.593024 15739 raft_consensus.cc:3037] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:21.594151 15386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d7a43495fdf46da91f5d96a18bd839f" candidate_uuid: "1b20e2b77f314b4abd9d1c2cda2afa49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308fe1daa1a14721b860d0615f9e0c8a" is_pre_election: true
I20260808 23:38:21.594740 15386 raft_consensus.cc:2454] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b20e2b77f314b4abd9d1c2cda2afa49 in term 0.
I20260808 23:38:21.597141 15739 raft_consensus.cc:504] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f461775876f74956a3b07e76420692db" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36231 } } peers { permanent_uuid: "1b20e2b77f314b4abd9d1c2cda2afa49" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33701 } } peers { permanent_uuid: "308fe1daa1a14721b860d0615f9e0c8a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33255 } }
I20260808 23:38:21.598150 15739 leader_election.cc:288] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [CANDIDATE]: Term 1 election: Requested vote from peers f461775876f74956a3b07e76420692db (127.26.207.195:36231), 308fe1daa1a14721b860d0615f9e0c8a (127.26.207.193:33255)
I20260808 23:38:21.598901 15663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d7a43495fdf46da91f5d96a18bd839f" candidate_uuid: "1b20e2b77f314b4abd9d1c2cda2afa49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f461775876f74956a3b07e76420692db"
I20260808 23:38:21.599184 15663 raft_consensus.cc:3037] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:21.599265 15386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d7a43495fdf46da91f5d96a18bd839f" candidate_uuid: "1b20e2b77f314b4abd9d1c2cda2afa49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308fe1daa1a14721b860d0615f9e0c8a"
I20260808 23:38:21.599467 15386 raft_consensus.cc:3037] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:21.602154 15386 raft_consensus.cc:2454] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b20e2b77f314b4abd9d1c2cda2afa49 in term 1.
I20260808 23:38:21.602830 15459 leader_election.cc:302] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b20e2b77f314b4abd9d1c2cda2afa49, 308fe1daa1a14721b860d0615f9e0c8a; no voters:
I20260808 23:38:21.603219 15739 raft_consensus.cc:2781] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:21.603564 15663 raft_consensus.cc:2454] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b20e2b77f314b4abd9d1c2cda2afa49 in term 1.
I20260808 23:38:21.603818 15739 raft_consensus.cc:686] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [term 1 LEADER]: Becoming Leader. State: Replica: 1b20e2b77f314b4abd9d1c2cda2afa49, State: Running, Role: LEADER
I20260808 23:38:21.604467 15739 consensus_queue.cc:237] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f461775876f74956a3b07e76420692db" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36231 } } peers { permanent_uuid: "1b20e2b77f314b4abd9d1c2cda2afa49" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33701 } } peers { permanent_uuid: "308fe1daa1a14721b860d0615f9e0c8a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33255 } }
I20260808 23:38:21.609922 15237 catalog_manager.cc:5495] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b20e2b77f314b4abd9d1c2cda2afa49 (127.26.207.194). New cstate: current_term: 1 leader_uuid: "1b20e2b77f314b4abd9d1c2cda2afa49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f461775876f74956a3b07e76420692db" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b20e2b77f314b4abd9d1c2cda2afa49" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 33701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "308fe1daa1a14721b860d0615f9e0c8a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33255 } health_report { overall_health: UNKNOWN } } }
I20260808 23:38:21.660468 15730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:21.652608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52222 (local address 127.26.207.194:33701)
0808 23:38:21.652868 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:21.652872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:21.652892 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:38:21.653122 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:21.653126 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:21.653225 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:21.653359 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:38:21.653958 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.654690 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.657662 (+ 2972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.658143 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.658265 (+ 122us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:21.659135 (+ 870us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:38:21.659678 (+ 543us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:38:21.659818 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:21.660087 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 23:38:21.660131 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 23:38:21.672768 15663 raft_consensus.cc:1261] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db [term 1 FOLLOWER]: Refusing update from remote peer 1b20e2b77f314b4abd9d1c2cda2afa49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:38:21.672947 15386 raft_consensus.cc:1261] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a [term 1 FOLLOWER]: Refusing update from remote peer 1b20e2b77f314b4abd9d1c2cda2afa49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260808 23:38:21.674212 15436 tablet.cc:2369] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:38:21.674197 15744 consensus_queue.cc:1035] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f461775876f74956a3b07e76420692db" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 36231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:38:21.674729 15739 consensus_queue.cc:1035] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308fe1daa1a14721b860d0615f9e0c8a" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:38:21.695909 15748 mvcc.cc:205] Tried to move back new op lower bound from 7316407507638964224 to 7316407507377668096. Current Snapshot: MvccSnapshot[applied={T|T < 7316407507638964224}]
I20260808 23:38:21.697407 15747 mvcc.cc:205] Tried to move back new op lower bound from 7316407507638964224 to 7316407507377668096. Current Snapshot: MvccSnapshot[applied={T|T < 7316407507638964224}]
I20260808 23:38:21.711735 15236 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50846:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:38:21.712085 15236 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50846:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:38:21.718214 15236 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 925b4c9e26a642d2a7120fed8af093b0: Sending DeleteTablet for 3 replicas of tablet 9d7a43495fdf46da91f5d96a18bd839f
I20260808 23:38:21.720475 15643 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d7a43495fdf46da91f5d96a18bd839f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:21 UTC) from {username='slave'} at 127.0.0.1:34258
I20260808 23:38:21.721099 15506 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d7a43495fdf46da91f5d96a18bd839f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:21 UTC) from {username='slave'} at 127.0.0.1:52216
I20260808 23:38:21.723192 15365 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d7a43495fdf46da91f5d96a18bd839f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:21 UTC) from {username='slave'} at 127.0.0.1:58558
I20260808 23:38:21.729991 15759 tablet_replica.cc:330] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49: stopping tablet replica
I20260808 23:38:21.730724 15760 tablet_replica.cc:330] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a: stopping tablet replica
I20260808 23:38:21.732059 15760 raft_consensus.cc:2229] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:38:21.732817 15759 raft_consensus.cc:2229] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:38:21.734283 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 15300
I20260808 23:38:21.734512 15760 raft_consensus.cc:2258] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:21.735785 15758 tablet_replica.cc:330] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db: stopping tablet replica
I20260808 23:38:21.736310 15758 raft_consensus.cc:2229] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:38:21.736948 15758 raft_consensus.cc:2258] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:21.738152 15760 ts_tablet_manager.cc:1905] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:21.738830 15759 raft_consensus.cc:2258] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:21.742036 15758 ts_tablet_manager.cc:1905] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:21.743388 15759 ts_tablet_manager.cc:1905] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:21.746604 15760 ts_tablet_manager.cc:1918] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:21.746861 15760 log.cc:1196] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/9d7a43495fdf46da91f5d96a18bd839f
I20260808 23:38:21.747466 15760 ts_tablet_manager.cc:1939] T 9d7a43495fdf46da91f5d96a18bd839f P 308fe1daa1a14721b860d0615f9e0c8a: Deleting consensus metadata
I20260808 23:38:21.749706 15224 catalog_manager.cc:4841] TS 308fe1daa1a14721b860d0615f9e0c8a (127.26.207.193:33255): tablet 9d7a43495fdf46da91f5d96a18bd839f (table test-table [id=034d198158ec471e9362ba2d0e0c8b73]) successfully deleted
I20260808 23:38:21.751065 15758 ts_tablet_manager.cc:1918] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:21.751259 15758 log.cc:1196] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/9d7a43495fdf46da91f5d96a18bd839f
I20260808 23:38:21.751740 15758 ts_tablet_manager.cc:1939] T 9d7a43495fdf46da91f5d96a18bd839f P f461775876f74956a3b07e76420692db: Deleting consensus metadata
I20260808 23:38:21.753609 15224 catalog_manager.cc:4841] TS f461775876f74956a3b07e76420692db (127.26.207.195:36231): tablet 9d7a43495fdf46da91f5d96a18bd839f (table test-table [id=034d198158ec471e9362ba2d0e0c8b73]) successfully deleted
I20260808 23:38:21.755330 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:21.735813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58562 (local address 127.26.207.193:33255)
0808 23:38:21.735987 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:21.735993 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:21.738134 (+ 2141us) server_negotiation.cc:407] Connection header received
0808 23:38:21.738359 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:21.738364 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:21.738494 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:21.738590 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:21.739347 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.740531 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.742547 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.743190 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.743314 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:21.753438 (+ 10124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:21.753450 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:21.753470 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:21.754288 (+ 818us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:21.754356 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:21.754385 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:21.754492 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:21.754781 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 23:38:21.754920 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 23:38:21.756716 15430 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:21.758600 15759 ts_tablet_manager.cc:1918] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:21.758853 15759 log.cc:1196] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/9d7a43495fdf46da91f5d96a18bd839f
I20260808 23:38:21.759528 15759 ts_tablet_manager.cc:1939] T 9d7a43495fdf46da91f5d96a18bd839f P 1b20e2b77f314b4abd9d1c2cda2afa49: Deleting consensus metadata
I20260808 23:38:21.761453 15222 catalog_manager.cc:4841] TS 1b20e2b77f314b4abd9d1c2cda2afa49 (127.26.207.194:33701): tablet 9d7a43495fdf46da91f5d96a18bd839f (table test-table [id=034d198158ec471e9362ba2d0e0c8b73]) successfully deleted
I20260808 23:38:21.854878 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 15300
I20260808 23:38:21.879042 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 15440
I20260808 23:38:21.888134 15730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:21.879975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52228 (local address 127.26.207.194:33701)
0808 23:38:21.880169 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:21.880173 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:21.880198 (+ 25us) server_negotiation.cc:407] Connection header received
0808 23:38:21.880434 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:21.880438 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:21.880543 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:21.880646 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:21.881234 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.882084 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.884277 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:21.885006 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:21.885135 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:21.886514 (+ 1379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:21.886524 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:21.886540 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:21.887257 (+ 717us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:21.887312 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:21.887338 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:21.887454 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:21.887621 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 23:38:21.887719 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 23:38:21.888988 15568 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:22.009058 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 15440
I20260808 23:38:22.032821 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 15578
I20260808 23:38:22.040467 15729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:22.033694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34260 (local address 127.26.207.195:36231)
0808 23:38:22.033857 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:22.033861 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:22.033907 (+ 46us) server_negotiation.cc:407] Connection header received
0808 23:38:22.034095 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:22.034099 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:22.034209 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:22.034355 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:22.034761 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:22.035614 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:22.037245 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:22.037692 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:22.037809 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:22.038957 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:22.038967 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:22.038983 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:22.039585 (+ 602us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:22.039643 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:22.039664 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:22.039760 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:22.039965 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 23:38:22.040087 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 23:38:22.041298 15707 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:22.132371 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 15578
I20260808 23:38:22.153326 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 15204
I20260808 23:38:22.154723 15269 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:22.269568 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 15204
2026-08-08T23:38:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3352 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:22 dist-test-slave-1x4g krb5kdc[15769](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:22 dist-test-slave-1x4g krb5kdc[15769](info): set up 2 sockets
Aug 08 23:38:22 dist-test-slave-1x4g krb5kdc[15769](info): commencing operation
krb5kdc: starting...
W20260808 23:38:23.469722 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.006s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:38:23 dist-test-slave-1x4g krb5kdc[15769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:38:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:38:23.840080 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:45531
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:34691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:45531
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:24.215319 15783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:24.215667 15783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:24.215840 15783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:24.223554 15783 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:24.223706 15783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:24.223757 15783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:24.223845 15783 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:24.223917 15783 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:24.234604 15783 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:34691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:45531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:45531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:24.236176 15783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:24.237720 15783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:24.252082 15788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:24.252195 15789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:24.252254 15791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:24.253463 15783 server_base.cc:1034] running on GCE node
I20260808 23:38:24.254416 15783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:24.256173 15783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:24.257431 15783 hybrid_clock.cc:648] HybridClock initialized: now 1786232304257389 us; error 56 us; skew 500 ppm
I20260808 23:38:24.257829 15783 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:24 dist-test-slave-1x4g krb5kdc[15769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232304, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:24.266527 15783 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:38:24.268430 15783 webserver.cc:460] Webserver started at http://127.26.207.254:42735/ using document root <none> and password file <none>
I20260808 23:38:24.269348 15783 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:24.269526 15783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:24.269888 15783 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:24.273445 15783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "44c6b11a5b5f4c0e962bfbf611d9ebdc"
format_stamp: "Formatted at 2026-08-08 23:38:24 on dist-test-slave-1x4g"
server_key: "dba392101b70f8b43d1aba51658ec38b"
server_key_iv: "87773e03effb7a9384755de0726d31c0"
server_key_version: "encryptionkey@0"
I20260808 23:38:24.274350 15783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "44c6b11a5b5f4c0e962bfbf611d9ebdc"
format_stamp: "Formatted at 2026-08-08 23:38:24 on dist-test-slave-1x4g"
server_key: "dba392101b70f8b43d1aba51658ec38b"
server_key_iv: "87773e03effb7a9384755de0726d31c0"
server_key_version: "encryptionkey@0"
I20260808 23:38:24.280752 15783 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260808 23:38:24.285521 15799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:24.287235 15783 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260808 23:38:24.287485 15783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "44c6b11a5b5f4c0e962bfbf611d9ebdc"
format_stamp: "Formatted at 2026-08-08 23:38:24 on dist-test-slave-1x4g"
server_key: "dba392101b70f8b43d1aba51658ec38b"
server_key_iv: "87773e03effb7a9384755de0726d31c0"
server_key_version: "encryptionkey@0"
I20260808 23:38:24.287735 15783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:24.318840 15783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:24.323792 15783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:24.324260 15783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:24.346307 15854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:45531 every 8 connection(s)
I20260808 23:38:24.346302 15783 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:45531
I20260808 23:38:24.348039 15783 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:24.352500 15855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:24.357149 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 15783
I20260808 23:38:24.357350 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:24.357824 27455 external_mini_cluster.cc:1428] Setting key f189b83a315ad29e1730907b4fa4e9a1
I20260808 23:38:24.367586 15855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc: Bootstrap starting.
I20260808 23:38:24.372498 15855 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:24.374287 15855 log.cc:824] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc: Log is configured to *not* fsync() on all Append() calls
Aug 08 23:38:24 dist-test-slave-1x4g krb5kdc[15769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:38:24.378722 15855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc: No bootstrap required, opened a new log
I20260808 23:38:24.390856 15858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:24.359940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33714 (local address 127.26.207.254:45531)
0808 23:38:24.360873 (+ 933us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:24.360887 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:24.360933 (+ 46us) server_negotiation.cc:407] Connection header received
0808 23:38:24.362697 (+ 1764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:24.362724 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:24.363231 (+ 507us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:24.363623 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:24.365852 (+ 2229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:24.367316 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:24.369917 (+ 2601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:24.371173 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:24.371425 (+ 252us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:24.377997 (+ 6572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:24.378012 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:24.378043 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:24.378118 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:24.383118 (+ 5000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:24.384358 (+ 1240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:24.384370 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:24.384381 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:24.384655 (+ 274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:24.385512 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:24.385517 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:24.385520 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:24.386467 (+ 947us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:24.388171 (+ 1704us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:24.388563 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 23:38:24.389196 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":640,"thread_start_us":392,"threads_started":1}
I20260808 23:38:24.392165 15855 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c6b11a5b5f4c0e962bfbf611d9ebdc" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45531 } }
I20260808 23:38:24.392808 15855 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:24.392975 15855 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c6b11a5b5f4c0e962bfbf611d9ebdc, State: Initialized, Role: FOLLOWER
I20260808 23:38:24.393849 15855 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c6b11a5b5f4c0e962bfbf611d9ebdc" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45531 } }
I20260808 23:38:24.394259 15855 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:24.394419 15855 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:24.394667 15855 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:24.398321 15855 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c6b11a5b5f4c0e962bfbf611d9ebdc" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45531 } }
I20260808 23:38:24.399089 15855 leader_election.cc:302] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44c6b11a5b5f4c0e962bfbf611d9ebdc; no voters:
I20260808 23:38:24.399887 15855 leader_election.cc:288] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:24.400080 15860 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:24.400906 15860 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [term 1 LEADER]: Becoming Leader. State: Replica: 44c6b11a5b5f4c0e962bfbf611d9ebdc, State: Running, Role: LEADER
I20260808 23:38:24.401511 15860 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c6b11a5b5f4c0e962bfbf611d9ebdc" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45531 } }
I20260808 23:38:24.402299 15855 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:24.405194 15861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44c6b11a5b5f4c0e962bfbf611d9ebdc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c6b11a5b5f4c0e962bfbf611d9ebdc" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45531 } } }
I20260808 23:38:24.411290 15862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44c6b11a5b5f4c0e962bfbf611d9ebdc. Latest consensus state: current_term: 1 leader_uuid: "44c6b11a5b5f4c0e962bfbf611d9ebdc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c6b11a5b5f4c0e962bfbf611d9ebdc" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45531 } } }
I20260808 23:38:24.411983 15861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:24.412039 15862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:24.420547 15867 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:24.427709 15867 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:24.439836 15867 catalog_manager.cc:1347] Generated new cluster ID: b9b45d5e89f847f2a750a2a17b8a6a03
I20260808 23:38:24.439987 15867 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:24.453091 15867 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:24.454530 15867 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:24.470633 15867 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc: Generated new TSK 0
I20260808 23:38:24.471684 15867 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.207.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
Entry for principal kudu/127.26.207.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab.
I20260808 23:38:24.573491 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:45531
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:34691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:24.991976 15881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:24.992292 15881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:24.992390 15881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:25.000052 15881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:25.000190 15881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:25.000386 15881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:38:25.010974 15881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:34691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.193.keytab
--principal=kudu/127.26.207.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:45531
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:25.012611 15881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:25.014120 15881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:25.029222 15886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:25.029203 15887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:25.029120 15889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:25.030275 15881 server_base.cc:1034] running on GCE node
I20260808 23:38:25.031004 15881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:25.032160 15881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:25.033424 15881 hybrid_clock.cc:648] HybridClock initialized: now 1786232305033370 us; error 52 us; skew 500 ppm
I20260808 23:38:25.033800 15881 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:25 dist-test-slave-1x4g krb5kdc[15769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232305, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:25.037519 15881 init.cc:377] Logged in from keytab as kudu/127.26.207.193@KRBTEST.COM (short username kudu)
I20260808 23:38:25.039192 15881 webserver.cc:460] Webserver started at http://127.26.207.193:40569/ using document root <none> and password file <none>
I20260808 23:38:25.039994 15881 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:25.040169 15881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:25.040541 15881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:25.043905 15881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "496388cdf154413185b11f85e6603e58"
format_stamp: "Formatted at 2026-08-08 23:38:25 on dist-test-slave-1x4g"
server_key: "2fc9ddd46b740583b89cc6ae2e3cd75b"
server_key_iv: "3fbbe4d482d535a2452c5fcdcc8b4db8"
server_key_version: "encryptionkey@0"
I20260808 23:38:25.044870 15881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "496388cdf154413185b11f85e6603e58"
format_stamp: "Formatted at 2026-08-08 23:38:25 on dist-test-slave-1x4g"
server_key: "2fc9ddd46b740583b89cc6ae2e3cd75b"
server_key_iv: "3fbbe4d482d535a2452c5fcdcc8b4db8"
server_key_version: "encryptionkey@0"
I20260808 23:38:25.050876 15881 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 23:38:25.055088 15896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:25.056722 15881 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 23:38:25.057005 15881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "496388cdf154413185b11f85e6603e58"
format_stamp: "Formatted at 2026-08-08 23:38:25 on dist-test-slave-1x4g"
server_key: "2fc9ddd46b740583b89cc6ae2e3cd75b"
server_key_iv: "3fbbe4d482d535a2452c5fcdcc8b4db8"
server_key_version: "encryptionkey@0"
I20260808 23:38:25.057262 15881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:25.077780 15881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:25.082656 15881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:25.083029 15881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:25.084234 15881 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:25.085917 15881 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:25.086006 15881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:25.086201 15881 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:25.086275 15881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:25.124387 15881 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:33041
I20260808 23:38:25.124437 16014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:33041 every 8 connection(s)
I20260808 23:38:25.126199 15881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:38:25.128288 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 15881
I20260808 23:38:25.128501 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:38:25.129118 27455 external_mini_cluster.cc:1428] Setting key 05e3f7fe415e2fa992b6ec840416fd71
Aug 08 23:38:25 dist-test-slave-1x4g krb5kdc[15769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232305, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.193@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:38:25.153843 16017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:25.129782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:43961 (local address 127.26.207.254:45531)
0808 23:38:25.130377 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:25.130384 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:25.131827 (+ 1443us) server_negotiation.cc:407] Connection header received
0808 23:38:25.135110 (+ 3283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:25.135115 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:25.135199 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:25.135317 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:25.137981 (+ 2664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:25.138798 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:25.141681 (+ 2883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:25.142135 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:25.142265 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:25.147160 (+ 4895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:25.147167 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:25.147170 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:25.147214 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:25.150180 (+ 2966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:25.151106 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:25.151112 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:25.151115 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:25.151260 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:25.151768 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:25.151772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:25.151774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:25.152091 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:25.152267 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:25.153149 (+ 882us) server_negotiation.cc:299] Negotiation successful
0808 23:38:25.153447 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":316,"threads_started":1}
I20260808 23:38:25.155037 16018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:25.130563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:45531 (local address 127.26.207.193:43961)
0808 23:38:25.131623 (+ 1060us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:25.131682 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:25.134660 (+ 2978us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:25.135667 (+ 1007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:25.135683 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:25.136649 (+ 966us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:25.137661 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:25.137697 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:25.139024 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:25.139033 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:25.141435 (+ 2402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:25.141462 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:25.142445 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:25.142456 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:25.142819 (+ 363us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:25.143730 (+ 911us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:38:25.143774 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:25.146827 (+ 3053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:25.150382 (+ 3555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:25.150402 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:25.150427 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:25.150932 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:25.151395 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:25.151401 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:25.151405 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:25.151626 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:25.152238 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:25.152247 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:25.152661 (+ 414us) client_negotiation.cc:769] Sending connection context
0808 23:38:25.153045 (+ 384us) client_negotiation.cc:240] Negotiation successful
0808 23:38:25.153681 (+ 636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"thread_start_us":488,"threads_started":1}
I20260808 23:38:25.156975 16015 heartbeater.cc:347] Connected to a master server at 127.26.207.254:45531
I20260808 23:38:25.157392 16015 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:25.158406 16015 heartbeater.cc:511] Master 127.26.207.254:45531 requested a full tablet report, sending...
I20260808 23:38:25.161703 15818 ts_manager.cc:194] Registered new tserver with Master: 496388cdf154413185b11f85e6603e58 (127.26.207.193:33041)
I20260808 23:38:25.163554 15818 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.193@KRBTEST.COM'} at 127.26.207.193:43961
WARNING: no policy specified for kudu/127.26.207.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
Entry for principal kudu/127.26.207.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab.
I20260808 23:38:25.213795 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:45531
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:34691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:25.598031 16021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:25.598371 16021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:25.598472 16021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:25.606406 16021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:25.606551 16021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:25.606678 16021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:38:25.617455 16021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:34691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.194.keytab
--principal=kudu/127.26.207.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:45531
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:25.619102 16021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:25.620574 16021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:25.636096 16026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:25.636070 16029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:25.636015 16027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:25.636955 16021 server_base.cc:1034] running on GCE node
I20260808 23:38:25.637712 16021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:25.638878 16021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:25.640159 16021 hybrid_clock.cc:648] HybridClock initialized: now 1786232305640112 us; error 54 us; skew 500 ppm
I20260808 23:38:25.640591 16021 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:25 dist-test-slave-1x4g krb5kdc[15769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232305, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:25.644264 16021 init.cc:377] Logged in from keytab as kudu/127.26.207.194@KRBTEST.COM (short username kudu)
I20260808 23:38:25.645956 16021 webserver.cc:460] Webserver started at http://127.26.207.194:41807/ using document root <none> and password file <none>
I20260808 23:38:25.646701 16021 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:25.646816 16021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:25.647141 16021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:25.650491 16021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "f8b1e5d0ffd54af6a2c73300931099bd"
format_stamp: "Formatted at 2026-08-08 23:38:25 on dist-test-slave-1x4g"
server_key: "25658e2dcc39a52949da37026641f5cd"
server_key_iv: "0607795f42f1b4705570631121eb9400"
server_key_version: "encryptionkey@0"
I20260808 23:38:25.651337 16021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "f8b1e5d0ffd54af6a2c73300931099bd"
format_stamp: "Formatted at 2026-08-08 23:38:25 on dist-test-slave-1x4g"
server_key: "25658e2dcc39a52949da37026641f5cd"
server_key_iv: "0607795f42f1b4705570631121eb9400"
server_key_version: "encryptionkey@0"
I20260808 23:38:25.657497 16021 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 23:38:25.661479 16036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:25.663249 16021 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 23:38:25.663479 16021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "f8b1e5d0ffd54af6a2c73300931099bd"
format_stamp: "Formatted at 2026-08-08 23:38:25 on dist-test-slave-1x4g"
server_key: "25658e2dcc39a52949da37026641f5cd"
server_key_iv: "0607795f42f1b4705570631121eb9400"
server_key_version: "encryptionkey@0"
I20260808 23:38:25.663724 16021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:25.679809 16021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:25.684337 16021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:25.684895 16021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:25.686142 16021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:25.687909 16021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:25.688011 16021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:25.688167 16021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:25.688230 16021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:25.726182 16021 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:39629
I20260808 23:38:25.726377 16156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:39629 every 8 connection(s)
I20260808 23:38:25.727784 16021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:38:25.732877 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 16021
I20260808 23:38:25.733132 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:38:25.733640 27455 external_mini_cluster.cc:1428] Setting key 0f4fa407e6138f0363f01d284c6bdfe7
Aug 08 23:38:25 dist-test-slave-1x4g krb5kdc[15769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232305, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.194@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:38:25.754001 16159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:25.730939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:38141 (local address 127.26.207.254:45531)
0808 23:38:25.731457 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:25.731462 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:25.732686 (+ 1224us) server_negotiation.cc:407] Connection header received
0808 23:38:25.735048 (+ 2362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:25.735053 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:25.735124 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:25.735223 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:25.737188 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:25.738442 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:25.740507 (+ 2065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:25.741353 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:25.741531 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:25.746299 (+ 4768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:25.746307 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:25.746310 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:25.746356 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:25.749496 (+ 3140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:25.750753 (+ 1257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:25.750758 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:25.750760 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:25.750919 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:25.751564 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:25.751571 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:25.751576 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:25.752039 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:25.752218 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:25.753142 (+ 924us) server_negotiation.cc:299] Negotiation successful
0808 23:38:25.753478 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":273,"threads_started":1}
I20260808 23:38:25.754714 16160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:25.731635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:45531 (local address 127.26.207.194:38141)
0808 23:38:25.732467 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:25.732514 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:25.734661 (+ 2147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:25.735572 (+ 911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:25.735587 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:25.736201 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:25.736961 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:25.736986 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:25.738684 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:25.738689 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:25.740278 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:25.740298 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:25.741658 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:25.741665 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:25.741948 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:25.742783 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:38:25.742809 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:25.745899 (+ 3090us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:25.749719 (+ 3820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:25.749733 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:25.749757 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:25.750574 (+ 817us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:25.751054 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:25.751062 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:25.751069 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:25.751406 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:25.752199 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:25.752207 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:25.752621 (+ 414us) client_negotiation.cc:769] Sending connection context
0808 23:38:25.752989 (+ 368us) client_negotiation.cc:240] Negotiation successful
0808 23:38:25.753469 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":323,"threads_started":1}
I20260808 23:38:25.756512 16157 heartbeater.cc:347] Connected to a master server at 127.26.207.254:45531
I20260808 23:38:25.756930 16157 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:25.757771 16157 heartbeater.cc:511] Master 127.26.207.254:45531 requested a full tablet report, sending...
I20260808 23:38:25.759519 15818 ts_manager.cc:194] Registered new tserver with Master: f8b1e5d0ffd54af6a2c73300931099bd (127.26.207.194:39629)
I20260808 23:38:25.760440 15818 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.194@KRBTEST.COM'} at 127.26.207.194:38141
WARNING: no policy specified for kudu/127.26.207.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
Entry for principal kudu/127.26.207.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab.
I20260808 23:38:25.817335 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:45531
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:34691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:38:26.168098 16015 heartbeater.cc:503] Master 127.26.207.254:45531 was elected leader, sending a full tablet report...
W20260808 23:38:26.200037 16165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:26.200363 16165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:26.200525 16165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:26.213855 16165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:26.213996 16165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:26.214196 16165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:38:26.225502 16165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:34691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.195.keytab
--principal=kudu/127.26.207.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:45531
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:26.227020 16165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:26.228960 16165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:26.245280 16173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:26.245249 16171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:26.249222 16170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:26.251741 16165 server_base.cc:1034] running on GCE node
I20260808 23:38:26.252573 16165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:26.253832 16165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:26.255115 16165 hybrid_clock.cc:648] HybridClock initialized: now 1786232306255067 us; error 48 us; skew 500 ppm
I20260808 23:38:26.255589 16165 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:26 dist-test-slave-1x4g krb5kdc[15769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232306, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:26.263933 16165 init.cc:377] Logged in from keytab as kudu/127.26.207.195@KRBTEST.COM (short username kudu)
I20260808 23:38:26.266042 16165 webserver.cc:460] Webserver started at http://127.26.207.195:36967/ using document root <none> and password file <none>
I20260808 23:38:26.266865 16165 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:26.267067 16165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:26.267429 16165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:26.271013 16165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "0e225158d2674db7bb04ba58f0cfb141"
format_stamp: "Formatted at 2026-08-08 23:38:26 on dist-test-slave-1x4g"
server_key: "f2a6c6bdd51c0f864acbf2b200c8fa1f"
server_key_iv: "b06063af20da4b81f01468d947a5691f"
server_key_version: "encryptionkey@0"
I20260808 23:38:26.272002 16165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "0e225158d2674db7bb04ba58f0cfb141"
format_stamp: "Formatted at 2026-08-08 23:38:26 on dist-test-slave-1x4g"
server_key: "f2a6c6bdd51c0f864acbf2b200c8fa1f"
server_key_iv: "b06063af20da4b81f01468d947a5691f"
server_key_version: "encryptionkey@0"
I20260808 23:38:26.278951 16165 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 23:38:26.283386 16180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:26.285218 16165 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 23:38:26.285393 16165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "0e225158d2674db7bb04ba58f0cfb141"
format_stamp: "Formatted at 2026-08-08 23:38:26 on dist-test-slave-1x4g"
server_key: "f2a6c6bdd51c0f864acbf2b200c8fa1f"
server_key_iv: "b06063af20da4b81f01468d947a5691f"
server_key_version: "encryptionkey@0"
I20260808 23:38:26.285617 16165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:26.318786 16165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:26.324060 16165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:26.324349 16165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:26.325455 16165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:26.326947 16165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:26.327032 16165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:26.327131 16165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:26.327184 16165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:26.365190 16165 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:37227
I20260808 23:38:26.365228 16297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:37227 every 8 connection(s)
I20260808 23:38:26.366699 16165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:38:26.369599 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 16165
I20260808 23:38:26.369860 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:38:26.370584 27455 external_mini_cluster.cc:1428] Setting key d88cec97ff3625ac60e1d8982ae2d035
Aug 08 23:38:26 dist-test-slave-1x4g krb5kdc[15769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232306, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.195@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:38:26.392364 16301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:26.370115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:51639 (local address 127.26.207.254:45531)
0808 23:38:26.370700 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:26.370707 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:26.372146 (+ 1439us) server_negotiation.cc:407] Connection header received
0808 23:38:26.374394 (+ 2248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:26.374399 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:26.374480 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:26.374583 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:26.376332 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.377641 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.380239 (+ 2598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.380746 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.380952 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:26.384944 (+ 3992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:26.384950 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:26.384954 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:26.384996 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:26.388571 (+ 3575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:26.389648 (+ 1077us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:26.389655 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:26.389658 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:26.389818 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:26.390294 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:26.390298 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:26.390300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:26.390648 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:26.390839 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:26.391821 (+ 982us) server_negotiation.cc:299] Negotiation successful
0808 23:38:26.392035 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":279,"threads_started":1}
I20260808 23:38:26.393468 16302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:26.370784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:45531 (local address 127.26.207.195:51639)
0808 23:38:26.371692 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:26.371745 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:26.374096 (+ 2351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:26.374842 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:26.374851 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:26.375473 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:26.376115 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:26.376133 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.377906 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.377912 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:26.379968 (+ 2056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:26.379992 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.381066 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.381072 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:26.381311 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:26.382147 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:38:26.382174 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:26.384606 (+ 2432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:26.388864 (+ 4258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:26.388873 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:26.388893 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:26.389448 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:26.389948 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:38:26.389952 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:38:26.389954 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:38:26.390175 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:38:26.390818 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:26.390825 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:26.391299 (+ 474us) client_negotiation.cc:769] Sending connection context
0808 23:38:26.391590 (+ 291us) client_negotiation.cc:240] Negotiation successful
0808 23:38:26.392120 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":393,"threads_started":1}
I20260808 23:38:26.395066 16298 heartbeater.cc:347] Connected to a master server at 127.26.207.254:45531
I20260808 23:38:26.395435 16298 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:26.396253 16298 heartbeater.cc:511] Master 127.26.207.254:45531 requested a full tablet report, sending...
I20260808 23:38:26.398008 15818 ts_manager.cc:194] Registered new tserver with Master: 0e225158d2674db7bb04ba58f0cfb141 (127.26.207.195:37227)
I20260808 23:38:26.398936 15818 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.207.195@KRBTEST.COM'} at 127.26.207.195:51639
I20260808 23:38:26.399807 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:38:26.420017 16301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:26.404737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33726 (local address 127.26.207.254:45531)
0808 23:38:26.404972 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:26.404997 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:26.405483 (+ 486us) server_negotiation.cc:407] Connection header received
0808 23:38:26.405702 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:26.405708 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:26.405805 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:26.405926 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:26.407553 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.408314 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.409825 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.410276 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.410430 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:26.413402 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:26.413409 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:26.413413 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:26.413469 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:26.416552 (+ 3083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:26.417506 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:26.417511 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:26.417513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:26.417674 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:26.418236 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:26.418245 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:26.418248 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:26.418671 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:26.418945 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:26.419352 (+ 407us) server_negotiation.cc:299] Negotiation successful
0808 23:38:26.419643 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260808 23:38:26.424664 15817 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33726:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:38:26.432456 15817 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:38:26.473477 16315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:26.447766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37360 (local address 127.26.207.193:33041)
0808 23:38:26.464539 (+ 16773us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:26.464549 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:26.464584 (+ 35us) server_negotiation.cc:407] Connection header received
0808 23:38:26.464700 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:26.464708 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:26.465020 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:26.465315 (+ 295us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:26.466491 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.468253 (+ 1762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.470971 (+ 2718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.472015 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.472295 (+ 280us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:26.472517 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:26.472890 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 23:38:26.473102 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16580,"thread_start_us":16385,"threads_started":1}
I20260808 23:38:26.473549 16313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:26.447042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:39629 (local address 127.0.0.1:45308)
0808 23:38:26.457944 (+ 10902us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:26.457998 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:26.458236 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:26.464745 (+ 6509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:26.464754 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:26.464832 (+ 78us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:26.465367 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:26.465384 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.467538 (+ 2154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.467546 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:26.470449 (+ 2903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:26.470470 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.472696 (+ 2226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.472704 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:26.472901 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:26.472932 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 23:38:26.473002 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 23:38:26.473128 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10611,"mutex_wait_us":26,"thread_start_us":18611,"threads_started":1}
I20260808 23:38:26.474079 16317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:26.447230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:33041 (local address 127.0.0.1:37360)
0808 23:38:26.463557 (+ 16327us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:26.463595 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:26.463780 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:26.465764 (+ 1984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:26.465771 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:26.465808 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:26.466276 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:26.466292 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.468448 (+ 2156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.468453 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:26.470795 (+ 2342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:26.470806 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.472299 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.472306 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:26.472547 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:26.472617 (+ 70us) client_negotiation.cc:769] Sending connection context
0808 23:38:26.472801 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 23:38:26.473033 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16120,"mutex_wait_us":30,"thread_start_us":10237,"threads_started":1}
I20260808 23:38:26.474699 16314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:26.447207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45308 (local address 127.26.207.194:39629)
0808 23:38:26.462666 (+ 15459us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:26.462683 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:26.462736 (+ 53us) server_negotiation.cc:407] Connection header received
0808 23:38:26.462905 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:26.462920 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:26.463350 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:26.463664 (+ 314us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:26.465640 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.467348 (+ 1708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.470657 (+ 3309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.472252 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.472441 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:26.472661 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:26.473975 (+ 1314us) server_negotiation.cc:299] Negotiation successful
0808 23:38:26.474418 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15179,"thread_start_us":17231,"threads_started":1}
I20260808 23:38:26.477210 16318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:26.459720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43572 (local address 127.26.207.195:37227)
0808 23:38:26.466902 (+ 7182us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:26.466909 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:26.466939 (+ 30us) server_negotiation.cc:407] Connection header received
0808 23:38:26.467025 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:26.467038 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:26.467223 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:26.467449 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:26.468348 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.469968 (+ 1620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.472593 (+ 2625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.475932 (+ 3339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.476177 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:26.476368 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:26.476653 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 23:38:26.476853 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7010,"thread_start_us":6837,"threads_started":1}
I20260808 23:38:26.477226 16312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:26.459244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:37227 (local address 127.0.0.1:43572)
0808 23:38:26.466002 (+ 6758us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:26.466051 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:26.466220 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:26.467443 (+ 1223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:26.467447 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:26.467478 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:26.468075 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:26.468092 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.470139 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.470144 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:26.472389 (+ 2245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:26.472404 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.476213 (+ 3809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.476220 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:26.476414 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:26.476449 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 23:38:26.476575 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 23:38:26.476751 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6583,"mutex_wait_us":1,"thread_start_us":4653,"threads_started":1}
I20260808 23:38:26.478506 16088 tablet_service.cc:1467] Processing CreateTablet for tablet e8f7105720f446c8a7f968028eee5a2b (DEFAULT_TABLE table=test-table [id=d766c099962c42b98bce841b0ed72e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:26.478506 15948 tablet_service.cc:1467] Processing CreateTablet for tablet e8f7105720f446c8a7f968028eee5a2b (DEFAULT_TABLE table=test-table [id=d766c099962c42b98bce841b0ed72e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:26.480388 16088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8f7105720f446c8a7f968028eee5a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:26.480583 15948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8f7105720f446c8a7f968028eee5a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:26.481217 16232 tablet_service.cc:1467] Processing CreateTablet for tablet e8f7105720f446c8a7f968028eee5a2b (DEFAULT_TABLE table=test-table [id=d766c099962c42b98bce841b0ed72e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:26.482568 16232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8f7105720f446c8a7f968028eee5a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:26.497117 16320 tablet_bootstrap.cc:492] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd: Bootstrap starting.
I20260808 23:38:26.499967 16321 tablet_bootstrap.cc:492] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58: Bootstrap starting.
I20260808 23:38:26.501914 16319 tablet_bootstrap.cc:492] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141: Bootstrap starting.
I20260808 23:38:26.504369 16320 tablet_bootstrap.cc:654] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:26.504395 16321 tablet_bootstrap.cc:654] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:26.505652 16320 log.cc:824] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:26.505877 16319 tablet_bootstrap.cc:654] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:26.505877 16321 log.cc:824] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:26.507354 16319 log.cc:824] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:26.509578 16321 tablet_bootstrap.cc:492] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58: No bootstrap required, opened a new log
I20260808 23:38:26.509732 16320 tablet_bootstrap.cc:492] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd: No bootstrap required, opened a new log
I20260808 23:38:26.509953 16321 ts_tablet_manager.cc:1397] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.007s
I20260808 23:38:26.510052 16320 ts_tablet_manager.cc:1397] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.003s
I20260808 23:38:26.511148 16319 tablet_bootstrap.cc:492] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141: No bootstrap required, opened a new log
I20260808 23:38:26.511459 16319 ts_tablet_manager.cc:1397] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 23:38:26.518867 16321 raft_consensus.cc:348] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8b1e5d0ffd54af6a2c73300931099bd" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 39629 } } peers { permanent_uuid: "496388cdf154413185b11f85e6603e58" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33041 } } peers { permanent_uuid: "0e225158d2674db7bb04ba58f0cfb141" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37227 } }
I20260808 23:38:26.519388 16321 raft_consensus.cc:374] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:26.519495 16321 raft_consensus.cc:729] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 496388cdf154413185b11f85e6603e58, State: Initialized, Role: FOLLOWER
I20260808 23:38:26.520221 16321 consensus_queue.cc:260] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8b1e5d0ffd54af6a2c73300931099bd" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 39629 } } peers { permanent_uuid: "496388cdf154413185b11f85e6603e58" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33041 } } peers { permanent_uuid: "0e225158d2674db7bb04ba58f0cfb141" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37227 } }
I20260808 23:38:26.521543 16320 raft_consensus.cc:348] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8b1e5d0ffd54af6a2c73300931099bd" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 39629 } } peers { permanent_uuid: "496388cdf154413185b11f85e6603e58" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33041 } } peers { permanent_uuid: "0e225158d2674db7bb04ba58f0cfb141" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37227 } }
I20260808 23:38:26.522042 16320 raft_consensus.cc:374] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:26.522177 16320 raft_consensus.cc:729] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8b1e5d0ffd54af6a2c73300931099bd, State: Initialized, Role: FOLLOWER
I20260808 23:38:26.522498 16321 ts_tablet_manager.cc:1428] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260808 23:38:26.522749 16319 raft_consensus.cc:348] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8b1e5d0ffd54af6a2c73300931099bd" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 39629 } } peers { permanent_uuid: "496388cdf154413185b11f85e6603e58" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33041 } } peers { permanent_uuid: "0e225158d2674db7bb04ba58f0cfb141" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37227 } }
I20260808 23:38:26.522928 16320 consensus_queue.cc:260] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8b1e5d0ffd54af6a2c73300931099bd" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 39629 } } peers { permanent_uuid: "496388cdf154413185b11f85e6603e58" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33041 } } peers { permanent_uuid: "0e225158d2674db7bb04ba58f0cfb141" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37227 } }
I20260808 23:38:26.523236 16319 raft_consensus.cc:374] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:26.523361 16319 raft_consensus.cc:729] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e225158d2674db7bb04ba58f0cfb141, State: Initialized, Role: FOLLOWER
I20260808 23:38:26.524039 16319 consensus_queue.cc:260] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8b1e5d0ffd54af6a2c73300931099bd" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 39629 } } peers { permanent_uuid: "496388cdf154413185b11f85e6603e58" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33041 } } peers { permanent_uuid: "0e225158d2674db7bb04ba58f0cfb141" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37227 } }
I20260808 23:38:26.524219 16157 heartbeater.cc:503] Master 127.26.207.254:45531 was elected leader, sending a full tablet report...
I20260808 23:38:26.525151 16320 ts_tablet_manager.cc:1428] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd: Time spent starting tablet: real 0.015s user 0.014s sys 0.002s
I20260808 23:38:26.526286 16298 heartbeater.cc:503] Master 127.26.207.254:45531 was elected leader, sending a full tablet report...
I20260808 23:38:26.527016 16319 ts_tablet_manager.cc:1428] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141: Time spent starting tablet: real 0.015s user 0.012s sys 0.005s
W20260808 23:38:26.618819 16300 tablet.cc:2369] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:38:26.629513 16016 tablet.cc:2369] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:38:26.636766 16326 raft_consensus.cc:482] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 23:38:26.637202 16326 raft_consensus.cc:504] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8b1e5d0ffd54af6a2c73300931099bd" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 39629 } } peers { permanent_uuid: "496388cdf154413185b11f85e6603e58" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33041 } } peers { permanent_uuid: "0e225158d2674db7bb04ba58f0cfb141" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37227 } }
I20260808 23:38:26.639183 16326 leader_election.cc:288] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 496388cdf154413185b11f85e6603e58 (127.26.207.193:33041), 0e225158d2674db7bb04ba58f0cfb141 (127.26.207.195:37227)
I20260808 23:38:26.647315 16315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:26.639850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:44577 (local address 127.26.207.193:33041)
0808 23:38:26.640092 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:26.640097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:26.640637 (+ 540us) server_negotiation.cc:407] Connection header received
0808 23:38:26.640954 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:26.640962 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:26.641055 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:26.641176 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:26.641952 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.642926 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.645147 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.646184 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.646327 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:26.646386 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:26.646871 (+ 485us) server_negotiation.cc:299] Negotiation successful
0808 23:38:26.647031 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 23:38:26.647459 16328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:26.639739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:33041 (local address 127.26.207.194:44577)
0808 23:38:26.640506 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:26.640529 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:26.640689 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:26.641270 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:26.641276 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:26.641309 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:26.641756 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:26.641771 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.643091 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.643097 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:26.644940 (+ 1843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:26.644960 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.646443 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.646450 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:26.646658 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:26.646705 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 23:38:26.646808 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 23:38:26.646986 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":413,"threads_started":1}
I20260808 23:38:26.647809 16318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:26.640923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:41817 (local address 127.26.207.195:37227)
0808 23:38:26.641160 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:26.641166 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:26.641566 (+ 400us) server_negotiation.cc:407] Connection header received
0808 23:38:26.641716 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:26.641724 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:26.641807 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:26.641901 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:26.642585 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.643580 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.645645 (+ 2065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.646646 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.646840 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:26.646914 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:26.647389 (+ 475us) server_negotiation.cc:299] Negotiation successful
0808 23:38:26.647549 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 23:38:26.648427 16329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:26.640678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:37227 (local address 127.26.207.194:41817)
0808 23:38:26.641450 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:26.641467 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:26.641589 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:26.641937 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:26.641941 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:26.641966 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:26.642369 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:26.642382 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.643746 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.643750 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:26.645462 (+ 1712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:26.645478 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.646924 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.646930 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:26.647166 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:26.647201 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 23:38:26.648047 (+ 846us) client_negotiation.cc:240] Negotiation successful
0808 23:38:26.648176 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":410,"threads_started":1}
I20260808 23:38:26.648818 15969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8f7105720f446c8a7f968028eee5a2b" candidate_uuid: "f8b1e5d0ffd54af6a2c73300931099bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "496388cdf154413185b11f85e6603e58" is_pre_election: true
I20260808 23:38:26.649463 15969 raft_consensus.cc:2454] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8b1e5d0ffd54af6a2c73300931099bd in term 0.
I20260808 23:38:26.649574 16252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8f7105720f446c8a7f968028eee5a2b" candidate_uuid: "f8b1e5d0ffd54af6a2c73300931099bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e225158d2674db7bb04ba58f0cfb141" is_pre_election: true
I20260808 23:38:26.650143 16252 raft_consensus.cc:2454] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8b1e5d0ffd54af6a2c73300931099bd in term 0.
I20260808 23:38:26.650209 16037 leader_election.cc:302] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 496388cdf154413185b11f85e6603e58, f8b1e5d0ffd54af6a2c73300931099bd; no voters:
I20260808 23:38:26.650679 16326 raft_consensus.cc:2781] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:38:26.650862 16326 raft_consensus.cc:482] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:38:26.650990 16326 raft_consensus.cc:3037] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:26.653570 16326 raft_consensus.cc:504] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8b1e5d0ffd54af6a2c73300931099bd" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 39629 } } peers { permanent_uuid: "496388cdf154413185b11f85e6603e58" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33041 } } peers { permanent_uuid: "0e225158d2674db7bb04ba58f0cfb141" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37227 } }
I20260808 23:38:26.654299 16326 leader_election.cc:288] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [CANDIDATE]: Term 1 election: Requested vote from peers 496388cdf154413185b11f85e6603e58 (127.26.207.193:33041), 0e225158d2674db7bb04ba58f0cfb141 (127.26.207.195:37227)
I20260808 23:38:26.655005 15969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8f7105720f446c8a7f968028eee5a2b" candidate_uuid: "f8b1e5d0ffd54af6a2c73300931099bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "496388cdf154413185b11f85e6603e58"
I20260808 23:38:26.655083 16252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8f7105720f446c8a7f968028eee5a2b" candidate_uuid: "f8b1e5d0ffd54af6a2c73300931099bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e225158d2674db7bb04ba58f0cfb141"
I20260808 23:38:26.655277 15969 raft_consensus.cc:3037] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:26.655356 16252 raft_consensus.cc:3037] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:26.658329 15969 raft_consensus.cc:2454] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8b1e5d0ffd54af6a2c73300931099bd in term 1.
I20260808 23:38:26.658334 16252 raft_consensus.cc:2454] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8b1e5d0ffd54af6a2c73300931099bd in term 1.
I20260808 23:38:26.658888 16037 leader_election.cc:302] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e225158d2674db7bb04ba58f0cfb141, f8b1e5d0ffd54af6a2c73300931099bd; no voters:
I20260808 23:38:26.659271 16326 raft_consensus.cc:2781] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:26.659777 16326 raft_consensus.cc:686] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [term 1 LEADER]: Becoming Leader. State: Replica: f8b1e5d0ffd54af6a2c73300931099bd, State: Running, Role: LEADER
I20260808 23:38:26.660411 16326 consensus_queue.cc:237] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8b1e5d0ffd54af6a2c73300931099bd" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 39629 } } peers { permanent_uuid: "496388cdf154413185b11f85e6603e58" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33041 } } peers { permanent_uuid: "0e225158d2674db7bb04ba58f0cfb141" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37227 } }
I20260808 23:38:26.665611 15817 catalog_manager.cc:5495] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd reported cstate change: term changed from 0 to 1, leader changed from <none> to f8b1e5d0ffd54af6a2c73300931099bd (127.26.207.194). New cstate: current_term: 1 leader_uuid: "f8b1e5d0ffd54af6a2c73300931099bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8b1e5d0ffd54af6a2c73300931099bd" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 39629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "496388cdf154413185b11f85e6603e58" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e225158d2674db7bb04ba58f0cfb141" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37227 } health_report { overall_health: UNKNOWN } } }
I20260808 23:38:26.716373 16314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:26.710793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45310 (local address 127.26.207.194:39629)
0808 23:38:26.711025 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:26.711031 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:26.711051 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:38:26.711149 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:26.711153 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:26.711236 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:26.711373 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:38:26.711729 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.712511 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.714024 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.714461 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.714570 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:26.715100 (+ 530us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:38:26.715652 (+ 552us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:38:26.715769 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:26.715901 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 23:38:26.715982 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 23:38:26.726325 15969 raft_consensus.cc:1261] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58 [term 1 FOLLOWER]: Refusing update from remote peer f8b1e5d0ffd54af6a2c73300931099bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:38:26.726457 16252 raft_consensus.cc:1261] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141 [term 1 FOLLOWER]: Refusing update from remote peer f8b1e5d0ffd54af6a2c73300931099bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:38:26.727516 16330 consensus_queue.cc:1035] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "496388cdf154413185b11f85e6603e58" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 33041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:38:26.728073 16326 consensus_queue.cc:1035] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e225158d2674db7bb04ba58f0cfb141" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 23:38:26.730374 16158 tablet.cc:2369] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:38:26.743237 16333 mvcc.cc:205] Tried to move back new op lower bound from 7316407528339623936 to 7316407528085925888. Current Snapshot: MvccSnapshot[applied={T|T < 7316407528339623936}]
I20260808 23:38:26.746165 16334 mvcc.cc:205] Tried to move back new op lower bound from 7316407528339623936 to 7316407528085925888. Current Snapshot: MvccSnapshot[applied={T|T < 7316407528339623936}]
I20260808 23:38:26.759670 16335 mvcc.cc:205] Tried to move back new op lower bound from 7316407528339623936 to 7316407528085925888. Current Snapshot: MvccSnapshot[applied={T|T < 7316407528339623936}]
I20260808 23:38:26.770769 15817 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33726:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:38:26.771118 15817 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33726:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:38:26.775666 15817 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 44c6b11a5b5f4c0e962bfbf611d9ebdc: Sending DeleteTablet for 3 replicas of tablet e8f7105720f446c8a7f968028eee5a2b
I20260808 23:38:26.777479 16232 tablet_service.cc:1514] Processing DeleteTablet for tablet e8f7105720f446c8a7f968028eee5a2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:26 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:43572
I20260808 23:38:26.777420 15948 tablet_service.cc:1514] Processing DeleteTablet for tablet e8f7105720f446c8a7f968028eee5a2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:26 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:37360
I20260808 23:38:26.777612 16088 tablet_service.cc:1514] Processing DeleteTablet for tablet e8f7105720f446c8a7f968028eee5a2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:26 UTC) from {username='kudu', principal='kudu/127.26.207.254@KRBTEST.COM'} at 127.0.0.1:45308
I20260808 23:38:26.781562 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 15881
I20260808 23:38:26.791165 16345 tablet_replica.cc:330] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141: stopping tablet replica
I20260808 23:38:26.792107 16344 tablet_replica.cc:330] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58: stopping tablet replica
I20260808 23:38:26.792356 16345 raft_consensus.cc:2229] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:38:26.792222 16346 tablet_replica.cc:330] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd: stopping tablet replica
I20260808 23:38:26.792878 16344 raft_consensus.cc:2229] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:38:26.793143 16345 raft_consensus.cc:2258] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:26.793335 16346 raft_consensus.cc:2229] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:38:26.793471 16344 raft_consensus.cc:2258] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:26.796070 16345 ts_tablet_manager.cc:1905] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:26.796134 16344 ts_tablet_manager.cc:1905] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:26.801482 16346 raft_consensus.cc:2258] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 08 23:38:26 dist-test-slave-1x4g krb5kdc[15769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.193@KRBTEST.COM
I20260808 23:38:26.804147 16344 ts_tablet_manager.cc:1918] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:26.804360 16346 ts_tablet_manager.cc:1905] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:26.804426 16344 log.cc:1196] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/e8f7105720f446c8a7f968028eee5a2b
I20260808 23:38:26.805124 16344 ts_tablet_manager.cc:1939] T e8f7105720f446c8a7f968028eee5a2b P 496388cdf154413185b11f85e6603e58: Deleting consensus metadata
I20260808 23:38:26.807412 15800 catalog_manager.cc:4841] TS 496388cdf154413185b11f85e6603e58 (127.26.207.193:33041): tablet e8f7105720f446c8a7f968028eee5a2b (table test-table [id=d766c099962c42b98bce841b0ed72e14]) successfully deleted
I20260808 23:38:26.812018 16345 ts_tablet_manager.cc:1918] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:26.812229 16345 log.cc:1196] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/e8f7105720f446c8a7f968028eee5a2b
I20260808 23:38:26.812879 16345 ts_tablet_manager.cc:1939] T e8f7105720f446c8a7f968028eee5a2b P 0e225158d2674db7bb04ba58f0cfb141: Deleting consensus metadata
I20260808 23:38:26.814289 16315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:26.783815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37366 (local address 127.26.207.193:33041)
0808 23:38:26.784084 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:26.784094 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:26.786689 (+ 2595us) server_negotiation.cc:407] Connection header received
0808 23:38:26.786907 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:26.786916 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:26.787072 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:26.787221 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:26.794979 (+ 7758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.796136 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.798302 (+ 2166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.799050 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.799159 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:26.805635 (+ 6476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:26.805652 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:26.805673 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:26.805723 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:26.810001 (+ 4278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:26.811069 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:26.811080 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:26.811085 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:26.811293 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:26.811823 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:26.811831 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:26.811834 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:26.812565 (+ 731us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:26.812902 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:26.813614 (+ 712us) server_negotiation.cc:299] Negotiation successful
0808 23:38:26.813875 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 23:38:26.815004 16346 ts_tablet_manager.cc:1918] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:26.815104 15800 catalog_manager.cc:4841] TS 0e225158d2674db7bb04ba58f0cfb141 (127.26.207.195:37227): tablet e8f7105720f446c8a7f968028eee5a2b (table test-table [id=d766c099962c42b98bce841b0ed72e14]) successfully deleted
I20260808 23:38:26.815218 16346 log.cc:1196] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/e8f7105720f446c8a7f968028eee5a2b
I20260808 23:38:26.815858 16346 ts_tablet_manager.cc:1939] T e8f7105720f446c8a7f968028eee5a2b P f8b1e5d0ffd54af6a2c73300931099bd: Deleting consensus metadata
I20260808 23:38:26.816337 16010 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:26.818578 15802 catalog_manager.cc:4841] TS f8b1e5d0ffd54af6a2c73300931099bd (127.26.207.194:39629): tablet e8f7105720f446c8a7f968028eee5a2b (table test-table [id=d766c099962c42b98bce841b0ed72e14]) successfully deleted
I20260808 23:38:26.942297 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 15881
I20260808 23:38:26.965248 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 16021
Aug 08 23:38:26 dist-test-slave-1x4g krb5kdc[15769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.194@KRBTEST.COM
I20260808 23:38:26.984547 16314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:26.966141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45312 (local address 127.26.207.194:39629)
0808 23:38:26.966361 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:26.966367 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:26.966401 (+ 34us) server_negotiation.cc:407] Connection header received
0808 23:38:26.966471 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:26.966477 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:26.966564 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:26.966676 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:26.968087 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.969501 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.970860 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:26.971612 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:26.971755 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:26.976865 (+ 5110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:26.976884 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:26.976907 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:26.976972 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:26.981298 (+ 4326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:26.982187 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:26.982197 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:26.982201 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:26.982428 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:26.982832 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:26.982838 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:26.982841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:26.983326 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:26.983698 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:26.983862 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 23:38:26.984106 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 23:38:26.985563 16152 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:27.106616 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 16021
I20260808 23:38:27.131261 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 16165
Aug 08 23:38:27 dist-test-slave-1x4g krb5kdc[15769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.195@KRBTEST.COM
I20260808 23:38:27.148360 16318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:27.132202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43586 (local address 127.26.207.195:37227)
0808 23:38:27.132416 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:27.132425 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:27.132454 (+ 29us) server_negotiation.cc:407] Connection header received
0808 23:38:27.132678 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:27.132683 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:27.132750 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:27.132899 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:27.134455 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:27.135188 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:27.136619 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:27.137241 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:27.137350 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:27.142437 (+ 5087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:27.142456 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:27.142482 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:27.142533 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:27.145411 (+ 2878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:27.146266 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:27.146273 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:27.146275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:27.146419 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:27.146807 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:27.146810 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:27.146812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:27.147191 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:27.147410 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:27.147766 (+ 356us) server_negotiation.cc:299] Negotiation successful
0808 23:38:27.147943 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 23:38:27.149130 16293 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:27.242136 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 16165
I20260808 23:38:27.264396 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 15783
I20260808 23:38:27.265638 15850 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:27.383769 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 15783
2026-08-08T23:38:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (5112 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T23:38:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:27Z Disabled control of system clock
I20260808 23:38:27.486974 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:35229
--webserver_interface=127.26.207.254
--webserver_port=0
--builtin_ntp_servers=127.26.207.212:44389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:35229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 23:38:27.875128 16355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:27.875475 16355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:27.875563 16355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:27.883404 16355 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:27.883536 16355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:27.883576 16355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:27.883636 16355 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:27.883683 16355 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:27.893491 16355 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:35229
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:35229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:27.894858 16355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:27.896888 16355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:27.910485 16363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:27.910418 16360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:27.910511 16361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:27.911527 16355 server_base.cc:1034] running on GCE node
I20260808 23:38:27.912362 16355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:27.914032 16355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:27.915267 16355 hybrid_clock.cc:648] HybridClock initialized: now 1786232307915214 us; error 52 us; skew 500 ppm
I20260808 23:38:27.915692 16355 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:38:27.918402 16355 webserver.cc:460] Webserver started at http://127.26.207.254:44861/ using document root <none> and password file <none>
I20260808 23:38:27.919351 16355 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:27.919493 16355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:27.919862 16355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:27.923281 16355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "8d08e010ba914b0dbab0323a265595fb"
format_stamp: "Formatted at 2026-08-08 23:38:27 on dist-test-slave-1x4g"
server_key: "4ab1d729fe504f4b3ecbafc51bb51ad1"
server_key_iv: "c8a62159d01876946c78ef6b4c330b89"
server_key_version: "encryptionkey@0"
I20260808 23:38:27.924299 16355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "8d08e010ba914b0dbab0323a265595fb"
format_stamp: "Formatted at 2026-08-08 23:38:27 on dist-test-slave-1x4g"
server_key: "4ab1d729fe504f4b3ecbafc51bb51ad1"
server_key_iv: "c8a62159d01876946c78ef6b4c330b89"
server_key_version: "encryptionkey@0"
I20260808 23:38:27.930590 16355 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 23:38:27.934823 16369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:27.936533 16355 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 23:38:27.936877 16355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "8d08e010ba914b0dbab0323a265595fb"
format_stamp: "Formatted at 2026-08-08 23:38:27 on dist-test-slave-1x4g"
server_key: "4ab1d729fe504f4b3ecbafc51bb51ad1"
server_key_iv: "c8a62159d01876946c78ef6b4c330b89"
server_key_version: "encryptionkey@0"
I20260808 23:38:27.937176 16355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:27.965456 16355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:27.966478 16355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:27.966814 16355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:27.987378 16355 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:35229
I20260808 23:38:27.987385 16422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:35229 every 8 connection(s)
I20260808 23:38:27.988911 16355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:27.993332 16423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:27.994802 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 16355
I20260808 23:38:27.995018 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:27.995512 27455 external_mini_cluster.cc:1428] Setting key 609bfd03d47a656114e185ef319f30fb
I20260808 23:38:28.007041 16423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb: Bootstrap starting.
I20260808 23:38:28.009712 16427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:27.997666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55104 (local address 127.26.207.254:35229)
0808 23:38:27.998816 (+ 1150us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:27.998832 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:27.998877 (+ 45us) server_negotiation.cc:407] Connection header received
0808 23:38:28.000585 (+ 1708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:28.000615 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:28.001226 (+ 611us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:28.001635 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:28.002236 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:28.003526 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:28.004998 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:28.005696 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:28.005916 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:28.007219 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:28.007231 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:28.007251 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:28.007819 (+ 568us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:28.007909 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:28.007932 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:28.008062 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:28.008293 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 23:38:28.008635 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":418,"threads_started":1}
I20260808 23:38:28.010949 16423 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:28.012117 16423 log.cc:824] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:28.015285 16423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb: No bootstrap required, opened a new log
I20260808 23:38:28.023222 16423 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d08e010ba914b0dbab0323a265595fb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35229 } }
I20260808 23:38:28.023792 16423 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:28.023926 16423 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d08e010ba914b0dbab0323a265595fb, State: Initialized, Role: FOLLOWER
I20260808 23:38:28.024718 16423 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d08e010ba914b0dbab0323a265595fb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35229 } }
I20260808 23:38:28.025087 16423 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:28.025276 16423 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:28.025470 16423 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:28.027791 16423 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d08e010ba914b0dbab0323a265595fb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35229 } }
I20260808 23:38:28.028379 16423 leader_election.cc:302] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d08e010ba914b0dbab0323a265595fb; no voters:
I20260808 23:38:28.029073 16423 leader_election.cc:288] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:28.029248 16429 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:28.030009 16429 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [term 1 LEADER]: Becoming Leader. State: Replica: 8d08e010ba914b0dbab0323a265595fb, State: Running, Role: LEADER
I20260808 23:38:28.030579 16429 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d08e010ba914b0dbab0323a265595fb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35229 } }
I20260808 23:38:28.031510 16423 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:28.033788 16431 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d08e010ba914b0dbab0323a265595fb. Latest consensus state: current_term: 1 leader_uuid: "8d08e010ba914b0dbab0323a265595fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d08e010ba914b0dbab0323a265595fb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35229 } } }
I20260808 23:38:28.034283 16431 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:28.033788 16430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d08e010ba914b0dbab0323a265595fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d08e010ba914b0dbab0323a265595fb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35229 } } }
I20260808 23:38:28.035458 16430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:28.038157 16434 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:28.044168 16434 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:28.054044 16434 catalog_manager.cc:1347] Generated new cluster ID: c207d296798d4a3f861068ad037f0644
I20260808 23:38:28.054183 16434 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:28.073421 16434 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:28.075457 16434 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:28.097692 16434 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb: Generated new TSK 0
I20260808 23:38:28.098739 16434 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:38:28.114979 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.193:0
--local_ip_for_outbound_sockets=127.26.207.193
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35229
--builtin_ntp_servers=127.26.207.212:44389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 23:38:28.501801 16448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:28.502139 16448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:28.502307 16448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:28.510468 16448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:28.510596 16448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:28.510782 16448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.193
I20260808 23:38:28.521199 16448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.207.193
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.193
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:28.522662 16448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:28.524698 16448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:28.540694 16453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:28.540659 16455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:28.540673 16457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:28.541893 16448 server_base.cc:1034] running on GCE node
I20260808 23:38:28.542711 16448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:28.543849 16448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:28.545125 16448 hybrid_clock.cc:648] HybridClock initialized: now 1786232308545061 us; error 57 us; skew 500 ppm
I20260808 23:38:28.545559 16448 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:38:28.548514 16448 webserver.cc:460] Webserver started at http://127.26.207.193:37217/ using document root <none> and password file <none>
I20260808 23:38:28.549628 16448 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:28.549799 16448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:28.550189 16448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:28.553647 16448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/data/instance:
uuid: "5047c9c72ab94edc89aded1ecc060de2"
format_stamp: "Formatted at 2026-08-08 23:38:28 on dist-test-slave-1x4g"
server_key: "aedf1028109031f451f32d1a6099efba"
server_key_iv: "bc08533409ba6c442cdeb4896c381c40"
server_key_version: "encryptionkey@0"
I20260808 23:38:28.554584 16448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance:
uuid: "5047c9c72ab94edc89aded1ecc060de2"
format_stamp: "Formatted at 2026-08-08 23:38:28 on dist-test-slave-1x4g"
server_key: "aedf1028109031f451f32d1a6099efba"
server_key_iv: "bc08533409ba6c442cdeb4896c381c40"
server_key_version: "encryptionkey@0"
I20260808 23:38:28.560597 16448 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 23:38:28.565112 16464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:28.566721 16448 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:38:28.566957 16448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/wal
uuid: "5047c9c72ab94edc89aded1ecc060de2"
format_stamp: "Formatted at 2026-08-08 23:38:28 on dist-test-slave-1x4g"
server_key: "aedf1028109031f451f32d1a6099efba"
server_key_iv: "bc08533409ba6c442cdeb4896c381c40"
server_key_version: "encryptionkey@0"
I20260808 23:38:28.567232 16448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:28.586757 16448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:28.587745 16448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:28.588115 16448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:28.589267 16448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:28.590924 16448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:28.591066 16448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:28.591226 16448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:28.591325 16448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:28.627859 16448 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.193:38719
I20260808 23:38:28.627936 16580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.193:38719 every 8 connection(s)
I20260808 23:38:28.629515 16448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/data/info.pb
I20260808 23:38:28.635612 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 16448
I20260808 23:38:28.635840 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/wal/instance
I20260808 23:38:28.636528 27455 external_mini_cluster.cc:1428] Setting key 84f53a023aba1bde7bd907304ab3c590
I20260808 23:38:28.640185 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.194:0
--local_ip_for_outbound_sockets=127.26.207.194
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35229
--builtin_ntp_servers=127.26.207.212:44389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 23:38:28.647465 16583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:28.633037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.193:41361 (local address 127.26.207.254:35229)
0808 23:38:28.633673 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:28.633678 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:28.635030 (+ 1352us) server_negotiation.cc:407] Connection header received
0808 23:38:28.637991 (+ 2961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:28.637997 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:28.638117 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:28.638271 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:28.639879 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:28.640831 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:28.643831 (+ 3000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:28.644256 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:28.644366 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:28.646510 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:28.646516 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:28.646519 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:28.646542 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:28.646598 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:28.646613 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:28.646699 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:28.647037 (+ 338us) server_negotiation.cc:299] Negotiation successful
0808 23:38:28.647141 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":331,"threads_started":1}
I20260808 23:38:28.649435 16584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:28.633735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:35229 (local address 127.26.207.193:41361)
0808 23:38:28.634828 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:28.634872 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:28.637640 (+ 2768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:28.638577 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:28.638587 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:28.638697 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:28.639644 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:28.639675 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:28.641099 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:28.641109 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:28.643624 (+ 2515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:28.643646 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:28.644534 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:28.644544 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:28.644979 (+ 435us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:28.645992 (+ 1013us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:38:28.645998 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:28.646064 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:38:28.646213 (+ 149us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:28.646732 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:28.646747 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:28.646758 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 23:38:28.646978 (+ 220us) client_negotiation.cc:240] Negotiation successful
0808 23:38:28.647605 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":334,"threads_started":1}
I20260808 23:38:28.651379 16581 heartbeater.cc:347] Connected to a master server at 127.26.207.254:35229
I20260808 23:38:28.651767 16581 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:28.652878 16581 heartbeater.cc:511] Master 127.26.207.254:35229 requested a full tablet report, sending...
I20260808 23:38:28.655434 16388 ts_manager.cc:194] Registered new tserver with Master: 5047c9c72ab94edc89aded1ecc060de2 (127.26.207.193:38719)
I20260808 23:38:28.657881 16388 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.207.193:41361
W20260808 23:38:29.025067 16585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:29.025393 16585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:29.025542 16585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:29.033464 16585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:29.033589 16585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:29.033766 16585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.194
I20260808 23:38:29.043859 16585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.207.194
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.194
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:29.045369 16585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:29.047333 16585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:29.062166 16594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:29.062049 16592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:29.062670 16591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:29.063325 16585 server_base.cc:1034] running on GCE node
I20260808 23:38:29.064039 16585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:29.065230 16585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:29.066511 16585 hybrid_clock.cc:648] HybridClock initialized: now 1786232309066443 us; error 64 us; skew 500 ppm
I20260808 23:38:29.066931 16585 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:38:29.069757 16585 webserver.cc:460] Webserver started at http://127.26.207.194:40999/ using document root <none> and password file <none>
I20260808 23:38:29.070583 16585 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:29.070736 16585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:29.071107 16585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:29.074604 16585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/data/instance:
uuid: "ba2f28ed92cf43e09728448e0500a587"
format_stamp: "Formatted at 2026-08-08 23:38:29 on dist-test-slave-1x4g"
server_key: "bd1620e22faeddac46bfddc6e58f073a"
server_key_iv: "0b46951eab3408afc68ce59660201f13"
server_key_version: "encryptionkey@0"
I20260808 23:38:29.075624 16585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance:
uuid: "ba2f28ed92cf43e09728448e0500a587"
format_stamp: "Formatted at 2026-08-08 23:38:29 on dist-test-slave-1x4g"
server_key: "bd1620e22faeddac46bfddc6e58f073a"
server_key_iv: "0b46951eab3408afc68ce59660201f13"
server_key_version: "encryptionkey@0"
I20260808 23:38:29.082121 16585 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 23:38:29.086944 16602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:29.089052 16585 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 23:38:29.089318 16585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/wal
uuid: "ba2f28ed92cf43e09728448e0500a587"
format_stamp: "Formatted at 2026-08-08 23:38:29 on dist-test-slave-1x4g"
server_key: "bd1620e22faeddac46bfddc6e58f073a"
server_key_iv: "0b46951eab3408afc68ce59660201f13"
server_key_version: "encryptionkey@0"
I20260808 23:38:29.089619 16585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:29.115964 16585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:29.117100 16585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:29.117455 16585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:29.118657 16585 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:29.120414 16585 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:29.120556 16585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:29.120695 16585 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:29.120836 16585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:29.158561 16585 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.194:44073
I20260808 23:38:29.158670 16720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.194:44073 every 8 connection(s)
I20260808 23:38:29.160094 16585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/data/info.pb
I20260808 23:38:29.161270 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 16585
I20260808 23:38:29.161489 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/wal/instance
I20260808 23:38:29.162177 27455 external_mini_cluster.cc:1428] Setting key 973c0ac80584f7866c95f7eccfa52d10
I20260808 23:38:29.165962 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.207.195:0
--local_ip_for_outbound_sockets=127.26.207.195
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35229
--builtin_ntp_servers=127.26.207.212:44389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 23:38:29.176631 16723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:29.163605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.194:37695 (local address 127.26.207.254:35229)
0808 23:38:29.164161 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:29.164168 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:29.165717 (+ 1549us) server_negotiation.cc:407] Connection header received
0808 23:38:29.167772 (+ 2055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:29.167779 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:29.167877 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:29.168017 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:29.169615 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.170841 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.172927 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.173682 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.173844 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:29.175492 (+ 1648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:29.175509 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:29.175518 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:29.175550 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:29.175617 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:29.175638 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:29.175739 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:29.175996 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 23:38:29.176133 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":267,"threads_started":1}
I20260808 23:38:29.177655 16724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:29.164426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:35229 (local address 127.26.207.194:37695)
0808 23:38:29.165541 (+ 1115us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:29.165594 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:29.167440 (+ 1846us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:29.168304 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:29.168315 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:29.168429 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:29.169333 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:29.169370 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.171083 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.171087 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:29.172700 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:29.172716 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.173961 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.173967 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:29.174201 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:29.175054 (+ 853us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:38:29.175057 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:29.175105 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:38:29.175212 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:29.175748 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:29.175757 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:29.175764 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 23:38:29.175947 (+ 183us) client_negotiation.cc:240] Negotiation successful
0808 23:38:29.176322 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":400,"threads_started":1}
I20260808 23:38:29.179477 16721 heartbeater.cc:347] Connected to a master server at 127.26.207.254:35229
I20260808 23:38:29.179899 16721 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:29.181017 16721 heartbeater.cc:511] Master 127.26.207.254:35229 requested a full tablet report, sending...
I20260808 23:38:29.182978 16388 ts_manager.cc:194] Registered new tserver with Master: ba2f28ed92cf43e09728448e0500a587 (127.26.207.194:44073)
I20260808 23:38:29.184029 16388 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.207.194:37695
W20260808 23:38:29.545550 16726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:29.545868 16726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:29.546030 16726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:29.553726 16726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:29.553890 16726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:29.554085 16726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.207.195
I20260808 23:38:29.563771 16726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:44389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.207.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.207.195
--webserver_port=0
--tserver_master_addrs=127.26.207.254:35229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.207.195
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:29.565294 16726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:29.567201 16726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:29.582547 16732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:29.582722 16731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:29.582767 16735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:29.584115 16726 server_base.cc:1034] running on GCE node
I20260808 23:38:29.584964 16726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:29.586243 16726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:29.587494 16726 hybrid_clock.cc:648] HybridClock initialized: now 1786232309587438 us; error 46 us; skew 500 ppm
I20260808 23:38:29.587879 16726 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 23:38:29.590577 16726 webserver.cc:460] Webserver started at http://127.26.207.195:33041/ using document root <none> and password file <none>
I20260808 23:38:29.591398 16726 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:29.591540 16726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:29.591902 16726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:29.595575 16726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/data/instance:
uuid: "452ab038e48d400c88c2785b3e9c473b"
format_stamp: "Formatted at 2026-08-08 23:38:29 on dist-test-slave-1x4g"
server_key: "adfbaa5f1b35453f6d45b1e6db330a45"
server_key_iv: "5440959e3e6ef03b5784929ba362947f"
server_key_version: "encryptionkey@0"
I20260808 23:38:29.596534 16726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance:
uuid: "452ab038e48d400c88c2785b3e9c473b"
format_stamp: "Formatted at 2026-08-08 23:38:29 on dist-test-slave-1x4g"
server_key: "adfbaa5f1b35453f6d45b1e6db330a45"
server_key_iv: "5440959e3e6ef03b5784929ba362947f"
server_key_version: "encryptionkey@0"
I20260808 23:38:29.602624 16726 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260808 23:38:29.606818 16741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:29.608412 16726 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 23:38:29.608650 16726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/wal
uuid: "452ab038e48d400c88c2785b3e9c473b"
format_stamp: "Formatted at 2026-08-08 23:38:29 on dist-test-slave-1x4g"
server_key: "adfbaa5f1b35453f6d45b1e6db330a45"
server_key_iv: "5440959e3e6ef03b5784929ba362947f"
server_key_version: "encryptionkey@0"
I20260808 23:38:29.608968 16726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:29.627794 16726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:29.629001 16726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:29.629341 16726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:29.630666 16726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 23:38:29.632750 16726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 23:38:29.632947 16726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 23:38:29.633075 16726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 23:38:29.633168 16726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:29.662271 16581 heartbeater.cc:503] Master 127.26.207.254:35229 was elected leader, sending a full tablet report...
I20260808 23:38:29.671154 16726 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.195:34633
I20260808 23:38:29.671219 16859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.195:34633 every 8 connection(s)
I20260808 23:38:29.672847 16726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/data/info.pb
I20260808 23:38:29.676651 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 16726
I20260808 23:38:29.676898 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/wal/instance
I20260808 23:38:29.677397 27455 external_mini_cluster.cc:1428] Setting key 87d18075311f6f15476f9bccf119206f
I20260808 23:38:29.687426 16723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:29.675753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:58095 (local address 127.26.207.254:35229)
0808 23:38:29.675976 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:29.675980 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:29.677788 (+ 1808us) server_negotiation.cc:407] Connection header received
0808 23:38:29.680333 (+ 2545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:29.680341 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:29.680448 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:29.680568 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:29.681893 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.682641 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.684392 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.684939 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.685061 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:29.686652 (+ 1591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:29.686657 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:29.686661 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:29.686684 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:29.686722 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:29.686734 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:29.686816 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:29.687052 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 23:38:29.687151 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 23:38:29.688671 16862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:29.676320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:35229 (local address 127.26.207.195:58095)
0808 23:38:29.677573 (+ 1253us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:29.677625 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:29.680026 (+ 2401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:29.680922 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:29.680933 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:29.681081 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:38:29.681725 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:29.681743 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.682809 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.682813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:29.684179 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:29.684193 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.685199 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.685204 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:29.685448 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:29.686244 (+ 796us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 23:38:29.686248 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:38:29.686296 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 23:38:29.686412 (+ 116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:38:29.686834 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:38:29.686844 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:38:29.686850 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 23:38:29.687038 (+ 188us) client_negotiation.cc:240] Negotiation successful
0808 23:38:29.687396 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"thread_start_us":453,"threads_started":1}
I20260808 23:38:29.690347 16860 heartbeater.cc:347] Connected to a master server at 127.26.207.254:35229
I20260808 23:38:29.690729 16860 heartbeater.cc:464] Registering TS with master...
I20260808 23:38:29.691727 16860 heartbeater.cc:511] Master 127.26.207.254:35229 requested a full tablet report, sending...
I20260808 23:38:29.693539 16387 ts_manager.cc:194] Registered new tserver with Master: 452ab038e48d400c88c2785b3e9c473b (127.26.207.195:34633)
I20260808 23:38:29.694554 16387 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.207.195:58095
I20260808 23:38:29.706924 27455 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 23:38:29.718621 16723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:29.711994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57516 (local address 127.26.207.254:35229)
0808 23:38:29.712290 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:29.712297 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:29.712821 (+ 524us) server_negotiation.cc:407] Connection header received
0808 23:38:29.712903 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:29.712907 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:29.712979 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:29.713073 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:29.713651 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.714500 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.715936 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.716360 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.716462 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:29.717755 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:29.717760 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:29.717763 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:29.717785 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:29.717821 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:29.717833 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:29.717918 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:29.718104 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 23:38:29.718198 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 23:38:29.724094 16387 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57516:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 23:38:29.731514 16387 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 23:38:29.758191 16872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:29.746070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.195:34633 (local address 127.0.0.1:52526)
0808 23:38:29.746919 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:29.746972 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:29.747171 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:29.749603 (+ 2432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:29.749612 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:29.749663 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:29.750390 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:29.750411 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.752575 (+ 2164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.752583 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:29.755349 (+ 2766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:29.755373 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.757001 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.757008 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:29.757230 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:29.757297 (+ 67us) client_negotiation.cc:769] Sending connection context
0808 23:38:29.757466 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 23:38:29.757710 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"mutex_wait_us":160,"spinlock_wait_cycles":4992,"thread_start_us":381,"threads_started":1}
I20260808 23:38:29.758621 16874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:29.746763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:38719 (local address 127.0.0.1:51210)
0808 23:38:29.747866 (+ 1103us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:29.747889 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:29.748017 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:29.749617 (+ 1600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:29.749622 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:29.749657 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:29.750452 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:29.750465 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.753148 (+ 2683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.753155 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:29.755484 (+ 2329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:29.755517 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.757698 (+ 2181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.757704 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:29.757893 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:29.757926 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 23:38:29.758000 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 23:38:29.758151 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":973,"mutex_wait_us":69,"spinlock_wait_cycles":896,"thread_start_us":1133,"threads_started":1}
I20260808 23:38:29.759590 16876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:29.747682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51210 (local address 127.26.207.193:38719)
0808 23:38:29.749050 (+ 1368us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:29.749057 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:29.749083 (+ 26us) server_negotiation.cc:407] Connection header received
0808 23:38:29.749204 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:29.749209 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:29.749376 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:29.751280 (+ 1904us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:29.751561 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.753000 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.755757 (+ 2757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.757468 (+ 1711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.758943 (+ 1475us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:29.759093 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:29.759160 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 23:38:29.759291 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1187,"thread_start_us":1023,"threads_started":1}
I20260808 23:38:29.759791 16873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:29.746347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52526 (local address 127.26.207.195:34633)
0808 23:38:29.748712 (+ 2365us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:29.748726 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:29.748799 (+ 73us) server_negotiation.cc:407] Connection header received
0808 23:38:29.748934 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:29.748946 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:29.749283 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:29.749553 (+ 270us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:29.750693 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.752403 (+ 1710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.755643 (+ 3240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.756729 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.757030 (+ 301us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:29.757292 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:29.759151 (+ 1859us) server_negotiation.cc:299] Negotiation successful
0808 23:38:29.759359 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2130,"thread_start_us":1934,"threads_started":1}
I20260808 23:38:29.760565 16875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:29.747700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55948 (local address 127.26.207.194:44073)
0808 23:38:29.751163 (+ 3463us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:29.751172 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:29.751205 (+ 33us) server_negotiation.cc:407] Connection header received
0808 23:38:29.751303 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:29.751311 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:29.751600 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:29.751819 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:29.752424 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.754077 (+ 1653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.756838 (+ 2761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.758367 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.758553 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:29.759871 (+ 1318us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:29.759956 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 23:38:29.760181 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3297,"thread_start_us":3167,"threads_started":1}
I20260808 23:38:29.762697 16877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:29.748024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:44073 (local address 127.0.0.1:55948)
0808 23:38:29.750437 (+ 2413us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:29.750461 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:29.750600 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:29.751812 (+ 1212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:29.751817 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:29.751846 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:29.752230 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:29.752242 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.754265 (+ 2023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.754271 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:29.756540 (+ 2269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:29.756559 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.759208 (+ 2649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.759215 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:29.759401 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:29.759434 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 23:38:29.759537 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 23:38:29.759680 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2249,"thread_start_us":2086,"threads_started":1}
I20260808 23:38:29.764039 16514 tablet_service.cc:1467] Processing CreateTablet for tablet 8f2eeb2393334a68a939248dafa8ab07 (DEFAULT_TABLE table=test-table [id=940c8c83a529499797da8398546983ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:29.764039 16794 tablet_service.cc:1467] Processing CreateTablet for tablet 8f2eeb2393334a68a939248dafa8ab07 (DEFAULT_TABLE table=test-table [id=940c8c83a529499797da8398546983ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:29.765796 16794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f2eeb2393334a68a939248dafa8ab07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:29.765808 16514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f2eeb2393334a68a939248dafa8ab07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:29.766681 16652 tablet_service.cc:1467] Processing CreateTablet for tablet 8f2eeb2393334a68a939248dafa8ab07 (DEFAULT_TABLE table=test-table [id=940c8c83a529499797da8398546983ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 23:38:29.768164 16652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f2eeb2393334a68a939248dafa8ab07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:29.782853 16878 tablet_bootstrap.cc:492] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587: Bootstrap starting.
I20260808 23:38:29.784466 16879 tablet_bootstrap.cc:492] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2: Bootstrap starting.
I20260808 23:38:29.785486 16880 tablet_bootstrap.cc:492] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b: Bootstrap starting.
I20260808 23:38:29.787225 16878 tablet_bootstrap.cc:654] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:29.788904 16878 log.cc:824] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:29.790016 16880 tablet_bootstrap.cc:654] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:29.791357 16880 log.cc:824] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:29.792510 16879 tablet_bootstrap.cc:654] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:29.792743 16878 tablet_bootstrap.cc:492] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587: No bootstrap required, opened a new log
I20260808 23:38:29.793215 16878 ts_tablet_manager.cc:1397] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.002s
I20260808 23:38:29.794073 16879 log.cc:824] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:29.796058 16880 tablet_bootstrap.cc:492] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b: No bootstrap required, opened a new log
I20260808 23:38:29.796367 16880 ts_tablet_manager.cc:1397] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.008s
I20260808 23:38:29.796968 16879 tablet_bootstrap.cc:492] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2: No bootstrap required, opened a new log
I20260808 23:38:29.797235 16879 ts_tablet_manager.cc:1397] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.006s
I20260808 23:38:29.805142 16879 raft_consensus.cc:348] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452ab038e48d400c88c2785b3e9c473b" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34633 } } peers { permanent_uuid: "ba2f28ed92cf43e09728448e0500a587" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44073 } } peers { permanent_uuid: "5047c9c72ab94edc89aded1ecc060de2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38719 } }
I20260808 23:38:29.805042 16878 raft_consensus.cc:348] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452ab038e48d400c88c2785b3e9c473b" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34633 } } peers { permanent_uuid: "ba2f28ed92cf43e09728448e0500a587" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44073 } } peers { permanent_uuid: "5047c9c72ab94edc89aded1ecc060de2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38719 } }
I20260808 23:38:29.805569 16878 raft_consensus.cc:374] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:29.805572 16879 raft_consensus.cc:374] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:29.805675 16879 raft_consensus.cc:729] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5047c9c72ab94edc89aded1ecc060de2, State: Initialized, Role: FOLLOWER
I20260808 23:38:29.805732 16878 raft_consensus.cc:729] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2f28ed92cf43e09728448e0500a587, State: Initialized, Role: FOLLOWER
I20260808 23:38:29.806375 16879 consensus_queue.cc:260] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452ab038e48d400c88c2785b3e9c473b" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34633 } } peers { permanent_uuid: "ba2f28ed92cf43e09728448e0500a587" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44073 } } peers { permanent_uuid: "5047c9c72ab94edc89aded1ecc060de2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38719 } }
I20260808 23:38:29.806438 16878 consensus_queue.cc:260] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452ab038e48d400c88c2785b3e9c473b" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34633 } } peers { permanent_uuid: "ba2f28ed92cf43e09728448e0500a587" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44073 } } peers { permanent_uuid: "5047c9c72ab94edc89aded1ecc060de2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38719 } }
I20260808 23:38:29.807850 16880 raft_consensus.cc:348] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452ab038e48d400c88c2785b3e9c473b" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34633 } } peers { permanent_uuid: "ba2f28ed92cf43e09728448e0500a587" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44073 } } peers { permanent_uuid: "5047c9c72ab94edc89aded1ecc060de2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38719 } }
I20260808 23:38:29.808382 16879 ts_tablet_manager.cc:1428] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260808 23:38:29.808646 16880 raft_consensus.cc:374] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:29.808853 16880 raft_consensus.cc:729] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452ab038e48d400c88c2785b3e9c473b, State: Initialized, Role: FOLLOWER
I20260808 23:38:29.809398 16721 heartbeater.cc:503] Master 127.26.207.254:35229 was elected leader, sending a full tablet report...
I20260808 23:38:29.809798 16880 consensus_queue.cc:260] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452ab038e48d400c88c2785b3e9c473b" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34633 } } peers { permanent_uuid: "ba2f28ed92cf43e09728448e0500a587" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44073 } } peers { permanent_uuid: "5047c9c72ab94edc89aded1ecc060de2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38719 } }
I20260808 23:38:29.810210 16878 ts_tablet_manager.cc:1428] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587: Time spent starting tablet: real 0.017s user 0.010s sys 0.005s
I20260808 23:38:29.812000 16860 heartbeater.cc:503] Master 127.26.207.254:35229 was elected leader, sending a full tablet report...
I20260808 23:38:29.812697 16880 ts_tablet_manager.cc:1428] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b: Time spent starting tablet: real 0.016s user 0.012s sys 0.004s
W20260808 23:38:29.882304 16582 tablet.cc:2369] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 23:38:29.912592 16722 tablet.cc:2369] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:38:29.924511 16886 raft_consensus.cc:482] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260808 23:38:29.924821 16861 tablet.cc:2369] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:38:29.924999 16886 raft_consensus.cc:504] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452ab038e48d400c88c2785b3e9c473b" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34633 } } peers { permanent_uuid: "ba2f28ed92cf43e09728448e0500a587" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44073 } } peers { permanent_uuid: "5047c9c72ab94edc89aded1ecc060de2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38719 } }
I20260808 23:38:29.927138 16886 leader_election.cc:288] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba2f28ed92cf43e09728448e0500a587 (127.26.207.194:44073), 5047c9c72ab94edc89aded1ecc060de2 (127.26.207.193:38719)
I20260808 23:38:29.934887 16875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:29.927624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:56643 (local address 127.26.207.194:44073)
0808 23:38:29.927825 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:29.927834 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:29.927869 (+ 35us) server_negotiation.cc:407] Connection header received
0808 23:38:29.928239 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:29.928247 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:29.928348 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:29.928457 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:29.929054 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.930020 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.932695 (+ 2675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.933958 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.934136 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:29.934217 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:29.934478 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 23:38:29.934622 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 23:38:29.934949 16862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:29.927555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.194:44073 (local address 127.26.207.195:56643)
0808 23:38:29.927774 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:29.927799 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:29.927972 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:29.928528 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:29.928534 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:29.928571 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:29.928851 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:29.928868 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.930170 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.930174 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:29.932496 (+ 2322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:29.932515 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.934140 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.934144 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:29.934271 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:29.934298 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 23:38:29.934407 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 23:38:29.934590 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"mutex_wait_us":24}
I20260808 23:38:29.935298 16876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:29.927992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.207.195:54741 (local address 127.26.207.193:38719)
0808 23:38:29.928260 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:29.928266 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:29.928731 (+ 465us) server_negotiation.cc:407] Connection header received
0808 23:38:29.928950 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:29.928953 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:29.929075 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:29.929178 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 23:38:29.929734 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.930565 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.933092 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.934341 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.934525 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:29.934589 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:29.934908 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 23:38:29.935073 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260808 23:38:29.935344 16887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:29.927555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.193:38719 (local address 127.26.207.195:54741)
0808 23:38:29.928593 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0808 23:38:29.928613 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 23:38:29.928762 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:38:29.929216 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:38:29.929219 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:38:29.929241 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 23:38:29.929562 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:29.929570 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.930712 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.930722 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:29.932867 (+ 2145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:38:29.932879 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:38:29.934547 (+ 1668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:38:29.934553 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:38:29.934721 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:29.934756 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 23:38:29.934849 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 23:38:29.934992 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":892,"mutex_wait_us":247,"thread_start_us":380,"threads_started":1}
I20260808 23:38:29.936432 16675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f2eeb2393334a68a939248dafa8ab07" candidate_uuid: "452ab038e48d400c88c2785b3e9c473b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2f28ed92cf43e09728448e0500a587" is_pre_election: true
I20260808 23:38:29.936548 16535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f2eeb2393334a68a939248dafa8ab07" candidate_uuid: "452ab038e48d400c88c2785b3e9c473b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5047c9c72ab94edc89aded1ecc060de2" is_pre_election: true
I20260808 23:38:29.937160 16675 raft_consensus.cc:2454] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 452ab038e48d400c88c2785b3e9c473b in term 0.
I20260808 23:38:29.937214 16535 raft_consensus.cc:2454] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 452ab038e48d400c88c2785b3e9c473b in term 0.
I20260808 23:38:29.938005 16746 leader_election.cc:302] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452ab038e48d400c88c2785b3e9c473b, 5047c9c72ab94edc89aded1ecc060de2; no voters:
I20260808 23:38:29.938498 16886 raft_consensus.cc:2781] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 23:38:29.938692 16886 raft_consensus.cc:482] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 23:38:29.938822 16886 raft_consensus.cc:3037] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:29.941520 16886 raft_consensus.cc:504] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452ab038e48d400c88c2785b3e9c473b" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34633 } } peers { permanent_uuid: "ba2f28ed92cf43e09728448e0500a587" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44073 } } peers { permanent_uuid: "5047c9c72ab94edc89aded1ecc060de2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38719 } }
I20260808 23:38:29.942378 16886 leader_election.cc:288] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [CANDIDATE]: Term 1 election: Requested vote from peers ba2f28ed92cf43e09728448e0500a587 (127.26.207.194:44073), 5047c9c72ab94edc89aded1ecc060de2 (127.26.207.193:38719)
I20260808 23:38:29.943017 16675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f2eeb2393334a68a939248dafa8ab07" candidate_uuid: "452ab038e48d400c88c2785b3e9c473b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2f28ed92cf43e09728448e0500a587"
I20260808 23:38:29.943025 16535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f2eeb2393334a68a939248dafa8ab07" candidate_uuid: "452ab038e48d400c88c2785b3e9c473b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5047c9c72ab94edc89aded1ecc060de2"
I20260808 23:38:29.943285 16675 raft_consensus.cc:3037] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:29.943285 16535 raft_consensus.cc:3037] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:29.946856 16535 raft_consensus.cc:2454] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452ab038e48d400c88c2785b3e9c473b in term 1.
I20260808 23:38:29.946856 16675 raft_consensus.cc:2454] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452ab038e48d400c88c2785b3e9c473b in term 1.
I20260808 23:38:29.947435 16742 leader_election.cc:302] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452ab038e48d400c88c2785b3e9c473b, ba2f28ed92cf43e09728448e0500a587; no voters:
I20260808 23:38:29.947871 16886 raft_consensus.cc:2781] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:29.948398 16886 raft_consensus.cc:686] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [term 1 LEADER]: Becoming Leader. State: Replica: 452ab038e48d400c88c2785b3e9c473b, State: Running, Role: LEADER
I20260808 23:38:29.949052 16886 consensus_queue.cc:237] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452ab038e48d400c88c2785b3e9c473b" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34633 } } peers { permanent_uuid: "ba2f28ed92cf43e09728448e0500a587" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44073 } } peers { permanent_uuid: "5047c9c72ab94edc89aded1ecc060de2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38719 } }
I20260808 23:38:29.954420 16387 catalog_manager.cc:5495] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b reported cstate change: term changed from 0 to 1, leader changed from <none> to 452ab038e48d400c88c2785b3e9c473b (127.26.207.195). New cstate: current_term: 1 leader_uuid: "452ab038e48d400c88c2785b3e9c473b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452ab038e48d400c88c2785b3e9c473b" member_type: VOTER last_known_addr { host: "127.26.207.195" port: 34633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2f28ed92cf43e09728448e0500a587" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5047c9c72ab94edc89aded1ecc060de2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38719 } health_report { overall_health: UNKNOWN } } }
I20260808 23:38:30.005873 16873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:29.999950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52528 (local address 127.26.207.195:34633)
0808 23:38:30.000293 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:30.000300 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:30.000320 (+ 20us) server_negotiation.cc:407] Connection header received
0808 23:38:30.000445 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:30.000450 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:30.000560 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:30.000743 (+ 183us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:38:30.001230 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:30.002007 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:30.003443 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:30.003881 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:30.004033 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:30.004599 (+ 566us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:38:30.005234 (+ 635us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:38:30.005403 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:30.005515 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 23:38:30.005603 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146}
I20260808 23:38:30.015437 16535 raft_consensus.cc:1261] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2 [term 1 FOLLOWER]: Refusing update from remote peer 452ab038e48d400c88c2785b3e9c473b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:38:30.015431 16675 raft_consensus.cc:1261] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587 [term 1 FOLLOWER]: Refusing update from remote peer 452ab038e48d400c88c2785b3e9c473b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:38:30.016763 16886 consensus_queue.cc:1035] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2f28ed92cf43e09728448e0500a587" member_type: VOTER last_known_addr { host: "127.26.207.194" port: 44073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:38:30.017259 16888 consensus_queue.cc:1035] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5047c9c72ab94edc89aded1ecc060de2" member_type: VOTER last_known_addr { host: "127.26.207.193" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:38:30.038941 16892 mvcc.cc:205] Tried to move back new op lower bound from 7316407541810307072 to 7316407541556727808. Current Snapshot: MvccSnapshot[applied={T|T < 7316407541810307072}]
I20260808 23:38:30.049803 16387 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57516:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:38:30.050129 16387 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57516:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 23:38:30.054234 16387 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8d08e010ba914b0dbab0323a265595fb: Sending DeleteTablet for 3 replicas of tablet 8f2eeb2393334a68a939248dafa8ab07
I20260808 23:38:30.056097 16794 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f2eeb2393334a68a939248dafa8ab07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:30 UTC) from {username='slave'} at 127.0.0.1:52526
I20260808 23:38:30.056288 16652 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f2eeb2393334a68a939248dafa8ab07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:30 UTC) from {username='slave'} at 127.0.0.1:55948
I20260808 23:38:30.057166 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 16448
I20260808 23:38:30.055794 16514 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f2eeb2393334a68a939248dafa8ab07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 23:38:30 UTC) from {username='slave'} at 127.0.0.1:51210
I20260808 23:38:30.065471 16904 tablet_replica.cc:330] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2: stopping tablet replica
I20260808 23:38:30.066251 16904 raft_consensus.cc:2229] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:38:30.067057 16904 raft_consensus.cc:2258] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:30.068517 16901 tablet_replica.cc:330] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b: stopping tablet replica
I20260808 23:38:30.069197 16901 raft_consensus.cc:2229] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [term 1 LEADER]: Raft consensus shutting down.
I20260808 23:38:30.070027 16901 raft_consensus.cc:2258] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:30.070039 16904 ts_tablet_manager.cc:1905] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:30.072980 16901 ts_tablet_manager.cc:1905] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:30.073593 16903 tablet_replica.cc:330] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587: stopping tablet replica
I20260808 23:38:30.074182 16903 raft_consensus.cc:2229] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 23:38:30.074842 16903 raft_consensus.cc:2258] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 23:38:30.077406 16903 ts_tablet_manager.cc:1905] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 23:38:30.082455 16904 ts_tablet_manager.cc:1918] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:30.082690 16904 log.cc:1196] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-0/wal/wals/8f2eeb2393334a68a939248dafa8ab07
I20260808 23:38:30.083292 16904 ts_tablet_manager.cc:1939] T 8f2eeb2393334a68a939248dafa8ab07 P 5047c9c72ab94edc89aded1ecc060de2: Deleting consensus metadata
I20260808 23:38:30.085459 16901 ts_tablet_manager.cc:1918] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:30.085700 16903 ts_tablet_manager.cc:1918] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 23:38:30.085776 16901 log.cc:1196] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-2/wal/wals/8f2eeb2393334a68a939248dafa8ab07
I20260808 23:38:30.085995 16903 log.cc:1196] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587: Deleting WAL directory at /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786231963826981-27455-0/minicluster-data/ts-1/wal/wals/8f2eeb2393334a68a939248dafa8ab07
I20260808 23:38:30.086501 16901 ts_tablet_manager.cc:1939] T 8f2eeb2393334a68a939248dafa8ab07 P 452ab038e48d400c88c2785b3e9c473b: Deleting consensus metadata
I20260808 23:38:30.086663 16903 ts_tablet_manager.cc:1939] T 8f2eeb2393334a68a939248dafa8ab07 P ba2f28ed92cf43e09728448e0500a587: Deleting consensus metadata
I20260808 23:38:30.087646 16876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:30.058953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51214 (local address 127.26.207.193:38719)
0808 23:38:30.059154 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:30.059163 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:30.072253 (+ 13090us) server_negotiation.cc:407] Connection header received
0808 23:38:30.072500 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:30.072506 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:30.072630 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:30.072759 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:30.073323 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:30.074558 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:30.076574 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:30.077261 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:30.077385 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:30.085496 (+ 8111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:30.085509 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:30.085528 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:30.086474 (+ 946us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:30.086558 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:30.086596 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:30.086729 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:30.087084 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 23:38:30.087235 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 23:38:30.088810 16371 catalog_manager.cc:4841] TS 452ab038e48d400c88c2785b3e9c473b (127.26.207.195:34633): tablet 8f2eeb2393334a68a939248dafa8ab07 (table test-table [id=940c8c83a529499797da8398546983ba]) successfully deleted
I20260808 23:38:30.088984 16575 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:30.089331 16374 catalog_manager.cc:4841] TS 5047c9c72ab94edc89aded1ecc060de2 (127.26.207.193:38719): tablet 8f2eeb2393334a68a939248dafa8ab07 (table test-table [id=940c8c83a529499797da8398546983ba]) successfully deleted
I20260808 23:38:30.090087 16371 catalog_manager.cc:4841] TS ba2f28ed92cf43e09728448e0500a587 (127.26.207.194:44073): tablet 8f2eeb2393334a68a939248dafa8ab07 (table test-table [id=940c8c83a529499797da8398546983ba]) successfully deleted
I20260808 23:38:30.185122 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 16448
I20260808 23:38:30.209074 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 16585
I20260808 23:38:30.219158 16875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:30.210227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55952 (local address 127.26.207.194:44073)
0808 23:38:30.210484 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:30.210491 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:30.210518 (+ 27us) server_negotiation.cc:407] Connection header received
0808 23:38:30.210596 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:30.210604 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:30.210743 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:30.210880 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:30.211318 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:30.212585 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:30.214454 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:30.215187 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:30.215355 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:30.217160 (+ 1805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:30.217174 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:30.217197 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:30.218099 (+ 902us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:30.218179 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:30.218211 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:30.218364 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:30.218600 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 23:38:30.218740 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 23:38:30.220122 16716 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:30.314002 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 16585
I20260808 23:38:30.337252 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 16726
I20260808 23:38:30.345666 16873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:30.338315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52540 (local address 127.26.207.195:34633)
0808 23:38:30.338525 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:30.338532 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:30.338555 (+ 23us) server_negotiation.cc:407] Connection header received
0808 23:38:30.338695 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:30.338707 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:30.338826 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:30.338965 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:30.339417 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:30.340257 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:30.341894 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:30.342437 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:30.342595 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:30.343968 (+ 1373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:30.343977 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:30.343994 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:30.344657 (+ 663us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:30.344749 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:30.344783 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:30.344987 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:30.345148 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 23:38:30.345268 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 23:38:30.346724 16855 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:30.476390 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 16726
I20260808 23:38:30.500739 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 16355
I20260808 23:38:30.502120 16418 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:30.617846 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 16355
2026-08-08T23:38:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3235 ms)
[----------] 6 tests from EncryptionPolicyTest (24943 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:30 dist-test-slave-1x4g krb5kdc[16912](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:30 dist-test-slave-1x4g krb5kdc[16912](info): set up 2 sockets
Aug 08 23:38:30 dist-test-slave-1x4g krb5kdc[16912](info): commencing operation
krb5kdc: starting...
W20260808 23:38:31.823832 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:38:32 dist-test-slave-1x4g krb5kdc[16912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:38:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 23:38:32.197515 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32821
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32821
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:32.578961 16925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:32.579303 16925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:32.579401 16925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:32.586982 16925 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:32.587129 16925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:32.587179 16925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:32.587246 16925 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:32.587292 16925 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:32.597858 16925 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32821
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:32.599304 16925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:32.600673 16925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:32.614090 16931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:32.614075 16932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:32.614163 16934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:32.614984 16925 server_base.cc:1034] running on GCE node
I20260808 23:38:32.615907 16925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:32.617679 16925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:32.618914 16925 hybrid_clock.cc:648] HybridClock initialized: now 1786232312618865 us; error 41 us; skew 500 ppm
I20260808 23:38:32.619350 16925 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:32 dist-test-slave-1x4g krb5kdc[16912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232312, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:32.629207 16925 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 23:38:32.631106 16925 webserver.cc:460] Webserver started at http://127.0.0.1:39065/ using document root <none> and password file <none>
I20260808 23:38:32.632012 16925 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:32.632166 16925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:32.632527 16925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:32.636014 16925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "32c80f8074244944b1313b41480c12bf"
format_stamp: "Formatted at 2026-08-08 23:38:32 on dist-test-slave-1x4g"
server_key: "4ef049e1e9e678d3aab38da69933b63c"
server_key_iv: "6ec851c8541ccef32184b5fbf5625208"
server_key_version: "encryptionkey@0"
I20260808 23:38:32.637045 16925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "32c80f8074244944b1313b41480c12bf"
format_stamp: "Formatted at 2026-08-08 23:38:32 on dist-test-slave-1x4g"
server_key: "4ef049e1e9e678d3aab38da69933b63c"
server_key_iv: "6ec851c8541ccef32184b5fbf5625208"
server_key_version: "encryptionkey@0"
I20260808 23:38:32.643106 16925 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 23:38:32.647324 16941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:32.649076 16925 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:38:32.649328 16925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "32c80f8074244944b1313b41480c12bf"
format_stamp: "Formatted at 2026-08-08 23:38:32 on dist-test-slave-1x4g"
server_key: "4ef049e1e9e678d3aab38da69933b63c"
server_key_iv: "6ec851c8541ccef32184b5fbf5625208"
server_key_version: "encryptionkey@0"
I20260808 23:38:32.649596 16925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:32.669211 16925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:32.674867 16925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:32.675230 16925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:32.695787 16925 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32821
I20260808 23:38:32.695820 16994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32821 every 8 connection(s)
I20260808 23:38:32.697476 16925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:32.701560 16995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:32.705585 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 16925
I20260808 23:38:32.705827 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:32.706741 27455 external_mini_cluster.cc:1428] Setting key 64da63cbc3cc52f98099a78cb3199c16
I20260808 23:38:32.716293 16995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf: Bootstrap starting.
I20260808 23:38:32.720693 16995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:32.722347 16995 log.cc:824] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf: Log is configured to *not* fsync() on all Append() calls
Aug 08 23:38:32 dist-test-slave-1x4g krb5kdc[16912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 23:38:32.726014 16995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf: No bootstrap required, opened a new log
I20260808 23:38:32.733515 16998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:32.709004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42741 (local address 127.0.0.1:32821)
0808 23:38:32.709851 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:32.709864 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:32.709913 (+ 49us) server_negotiation.cc:407] Connection header received
0808 23:38:32.711639 (+ 1726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:32.711664 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:32.712130 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:32.712495 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:32.714444 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:32.715794 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:32.717834 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:32.718610 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:32.718776 (+ 166us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:32.724609 (+ 5833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:32.724619 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:32.724636 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:32.724677 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:32.728239 (+ 3562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:32.729439 (+ 1200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:32.729457 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:32.729465 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:32.729687 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:32.730257 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:32.730261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:32.730263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:32.730922 (+ 659us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:32.731316 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:32.731863 (+ 547us) server_negotiation.cc:299] Negotiation successful
0808 23:38:32.732265 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":387,"threads_started":1}
I20260808 23:38:32.734766 16995 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32c80f8074244944b1313b41480c12bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32821 } }
I20260808 23:38:32.735216 16995 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:32.735349 16995 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32c80f8074244944b1313b41480c12bf, State: Initialized, Role: FOLLOWER
I20260808 23:38:32.735975 16995 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32c80f8074244944b1313b41480c12bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32821 } }
I20260808 23:38:32.736296 16995 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:32.736557 16995 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:32.736858 16995 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:32.738489 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:38:32.740067 16995 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32c80f8074244944b1313b41480c12bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32821 } }
I20260808 23:38:32.740839 16995 leader_election.cc:302] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32c80f8074244944b1313b41480c12bf; no voters:
I20260808 23:38:32.741654 16995 leader_election.cc:288] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:32.741803 17000 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:32.744643 16995 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:32.749150 17000 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [term 1 LEADER]: Becoming Leader. State: Replica: 32c80f8074244944b1313b41480c12bf, State: Running, Role: LEADER
I20260808 23:38:32.750070 17000 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32c80f8074244944b1313b41480c12bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32821 } }
I20260808 23:38:32.753755 17001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32c80f8074244944b1313b41480c12bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32c80f8074244944b1313b41480c12bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32821 } } }
I20260808 23:38:32.754200 17001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:32.754932 17003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32c80f8074244944b1313b41480c12bf. Latest consensus state: current_term: 1 leader_uuid: "32c80f8074244944b1313b41480c12bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32c80f8074244944b1313b41480c12bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32821 } } }
I20260808 23:38:32.755275 17003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:32.758716 17012 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:32.764339 17012 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:32.776001 16998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:32.753282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50597 (local address 127.0.0.1:32821)
0808 23:38:32.753527 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:32.753536 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:32.756412 (+ 2876us) server_negotiation.cc:407] Connection header received
0808 23:38:32.756811 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:32.756820 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:32.756923 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:32.757030 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:32.759558 (+ 2528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:32.760953 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:32.762997 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:32.763681 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:32.763825 (+ 144us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:32.767518 (+ 3693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:32.767527 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:32.767534 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:32.767587 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:32.771763 (+ 4176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:32.773128 (+ 1365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:32.773136 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:32.773142 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:32.773325 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:32.773985 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:32.773990 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:32.773994 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:32.774499 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:32.774810 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:32.775357 (+ 547us) server_negotiation.cc:299] Negotiation successful
0808 23:38:32.775580 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 23:38:32.776616 17012 catalog_manager.cc:1347] Generated new cluster ID: 649fb7bdffe4401a81225379900ad1a4
I20260808 23:38:32.776829 17012 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:32.812448 17012 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:32.814455 17012 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:32.840955 17012 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32c80f8074244944b1313b41480c12bf: Generated new TSK 0
I20260808 23:38:32.842300 17012 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:38:32.859521 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 16925
I20260808 23:38:32.861472 16990 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:32.964886 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 16925
W20260808 23:38:32.987883 16910 connection.cc:535] client connection to 127.0.0.1:32821 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32821): Connection reset by peer (error 104)
2026-08-08T23:38:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2340 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:33 dist-test-slave-1x4g krb5kdc[17029](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:33 dist-test-slave-1x4g krb5kdc[17029](info): set up 2 sockets
Aug 08 23:38:33 dist-test-slave-1x4g krb5kdc[17029](info): commencing operation
krb5kdc: starting...
W20260808 23:38:34.162598 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.155s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:38:34 dist-test-slave-1x4g krb5kdc[17029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:38:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 23:38:34.549028 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33443
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33443
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:34.927861 17042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:34.928212 17042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:34.928385 17042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:34.936064 17042 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:34.936209 17042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:34.936296 17042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:34.936419 17042 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:34.936514 17042 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:34.948004 17042 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33443
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:34.949666 17042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:34.951144 17042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:34.964815 17047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:34.964877 17048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:34.964901 17050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:34.965885 17042 server_base.cc:1034] running on GCE node
I20260808 23:38:34.966806 17042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:34.968505 17042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:34.969732 17042 hybrid_clock.cc:648] HybridClock initialized: now 1786232314969672 us; error 54 us; skew 500 ppm
I20260808 23:38:34.970168 17042 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:34 dist-test-slave-1x4g krb5kdc[17029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232314, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:34.974140 17042 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 23:38:34.976083 17042 webserver.cc:460] Webserver started at http://127.0.0.1:34041/ using document root <none> and password file <none>
I20260808 23:38:34.976998 17042 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:34.977171 17042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:34.977530 17042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:34.981060 17042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "64e85027e1bc4266bb6e6c7026cabeb0"
format_stamp: "Formatted at 2026-08-08 23:38:34 on dist-test-slave-1x4g"
server_key: "3f78bb9e23794768f8c5bfc3d1433252"
server_key_iv: "2afd62929da02aae91addc53ca6b69c8"
server_key_version: "encryptionkey@0"
I20260808 23:38:34.982000 17042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "64e85027e1bc4266bb6e6c7026cabeb0"
format_stamp: "Formatted at 2026-08-08 23:38:34 on dist-test-slave-1x4g"
server_key: "3f78bb9e23794768f8c5bfc3d1433252"
server_key_iv: "2afd62929da02aae91addc53ca6b69c8"
server_key_version: "encryptionkey@0"
I20260808 23:38:34.988197 17042 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 23:38:34.992617 17057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:34.994453 17042 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:38:34.994717 17042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "64e85027e1bc4266bb6e6c7026cabeb0"
format_stamp: "Formatted at 2026-08-08 23:38:34 on dist-test-slave-1x4g"
server_key: "3f78bb9e23794768f8c5bfc3d1433252"
server_key_iv: "2afd62929da02aae91addc53ca6b69c8"
server_key_version: "encryptionkey@0"
I20260808 23:38:34.994978 17042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:35.007251 17042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:35.012162 17042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:35.012532 17042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:35.033502 17042 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33443
I20260808 23:38:35.033525 17111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33443 every 8 connection(s)
I20260808 23:38:35.035151 17042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:35.036374 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 17042
I20260808 23:38:35.036597 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:35.037252 27455 external_mini_cluster.cc:1428] Setting key 155291b409536d42d2ef95e9fb691878
I20260808 23:38:35.040548 17112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:35.052467 17116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:35.039436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54945 (local address 127.0.0.1:33443)
0808 23:38:35.040334 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:35.040348 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:35.040396 (+ 48us) server_negotiation.cc:407] Connection header received
0808 23:38:35.042419 (+ 2023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:35.042446 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:35.042901 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:35.043345 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:35.044031 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:35.045634 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:35.047332 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:35.048108 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:35.048335 (+ 227us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:35.049854 (+ 1519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:35.049863 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:35.049883 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:35.050536 (+ 653us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:35.050635 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:35.050664 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:35.050881 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:35.051183 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 23:38:35.051385 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":665,"thread_start_us":408,"threads_started":1}
I20260808 23:38:35.053705 17112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0: Bootstrap starting.
I20260808 23:38:35.057019 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:38:35.057682 17112 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:35.058854 17112 log.cc:824] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:35.062320 17112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0: No bootstrap required, opened a new log
I20260808 23:38:35.069221 17116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:35.061970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45525 (local address 127.0.0.1:33443)
0808 23:38:35.062174 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:35.062181 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:35.062647 (+ 466us) server_negotiation.cc:407] Connection header received
0808 23:38:35.062819 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:35.062827 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:35.062930 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:35.063081 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:35.063608 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:35.064812 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:35.066235 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:35.066938 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:35.067084 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:35.068280 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:35.068286 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:35.068291 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:35.068321 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:35.068395 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:35.068422 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:35.068548 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:35.068722 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 23:38:35.068813 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 23:38:35.072908 17112 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e85027e1bc4266bb6e6c7026cabeb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33443 } }
I20260808 23:38:35.073392 17112 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:35.073534 17112 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64e85027e1bc4266bb6e6c7026cabeb0, State: Initialized, Role: FOLLOWER
I20260808 23:38:35.074177 17112 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e85027e1bc4266bb6e6c7026cabeb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33443 } }
I20260808 23:38:35.074422 17112 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:35.074594 17112 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:35.074795 17112 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:35.077273 17112 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e85027e1bc4266bb6e6c7026cabeb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33443 } }
I20260808 23:38:35.077978 17112 leader_election.cc:302] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64e85027e1bc4266bb6e6c7026cabeb0; no voters:
I20260808 23:38:35.078686 17112 leader_election.cc:288] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:35.078892 17124 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:35.079694 17124 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [term 1 LEADER]: Becoming Leader. State: Replica: 64e85027e1bc4266bb6e6c7026cabeb0, State: Running, Role: LEADER
I20260808 23:38:35.080300 17124 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e85027e1bc4266bb6e6c7026cabeb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33443 } }
I20260808 23:38:35.081107 17112 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:35.083730 17125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64e85027e1bc4266bb6e6c7026cabeb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e85027e1bc4266bb6e6c7026cabeb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33443 } } }
I20260808 23:38:35.083698 17126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64e85027e1bc4266bb6e6c7026cabeb0. Latest consensus state: current_term: 1 leader_uuid: "64e85027e1bc4266bb6e6c7026cabeb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e85027e1bc4266bb6e6c7026cabeb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33443 } } }
I20260808 23:38:35.084265 17125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:35.084276 17126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:35.086946 17133 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:35.092716 17133 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:35.104497 17133 catalog_manager.cc:1347] Generated new cluster ID: 3fa341e062a1432fb5257f8b9a0f508b
I20260808 23:38:35.104655 17133 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:35.123054 17133 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:35.124533 17133 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:35.135609 17133 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64e85027e1bc4266bb6e6c7026cabeb0: Generated new TSK 0
I20260808 23:38:35.136621 17133 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:38:35.143234 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 17042
W20260808 23:38:35.144713 17107 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54945
W20260808 23:38:35.145762 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 17042: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:38:35.146154 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 17042
W20260808 23:38:35.169196 17025 connection.cc:535] client connection to 127.0.0.1:33443 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33443): Connection reset by peer (error 104)
2026-08-08T23:38:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2181 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:35 dist-test-slave-1x4g krb5kdc[17145](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:35 dist-test-slave-1x4g krb5kdc[17145](info): set up 2 sockets
Aug 08 23:38:35 dist-test-slave-1x4g krb5kdc[17145](info): commencing operation
krb5kdc: starting...
W20260808 23:38:36.345265 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:38:36 dist-test-slave-1x4g krb5kdc[17145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:38:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 23:38:36.716723 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45583
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:37.095825 17158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:37.096189 17158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:37.096287 17158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:37.103860 17158 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:37.104007 17158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:37.104055 17158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:37.104110 17158 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:37.104156 17158 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:37.114485 17158 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45583
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:37.115895 17158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:37.117331 17158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:37.129628 17163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:37.129660 17164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:37.130963 17166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:37.132232 17158 server_base.cc:1034] running on GCE node
I20260808 23:38:37.133302 17158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:37.134950 17158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:37.136220 17158 hybrid_clock.cc:648] HybridClock initialized: now 1786232317136158 us; error 69 us; skew 500 ppm
I20260808 23:38:37.136643 17158 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:37 dist-test-slave-1x4g krb5kdc[17145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232317, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:37.140276 17158 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 23:38:37.142194 17158 webserver.cc:460] Webserver started at http://127.0.0.1:32963/ using document root <none> and password file <none>
I20260808 23:38:37.143028 17158 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:37.143193 17158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:37.143546 17158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:37.147161 17158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "71becc8b726a4920bf6436799640ced7"
format_stamp: "Formatted at 2026-08-08 23:38:37 on dist-test-slave-1x4g"
server_key: "3174eed471b7712d42a5e20138442f39"
server_key_iv: "c6e432af6ac62726e4585349b51af6a1"
server_key_version: "encryptionkey@0"
I20260808 23:38:37.148070 17158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "71becc8b726a4920bf6436799640ced7"
format_stamp: "Formatted at 2026-08-08 23:38:37 on dist-test-slave-1x4g"
server_key: "3174eed471b7712d42a5e20138442f39"
server_key_iv: "c6e432af6ac62726e4585349b51af6a1"
server_key_version: "encryptionkey@0"
I20260808 23:38:37.154330 17158 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 23:38:37.158437 17173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:37.160055 17158 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:38:37.160295 17158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "71becc8b726a4920bf6436799640ced7"
format_stamp: "Formatted at 2026-08-08 23:38:37 on dist-test-slave-1x4g"
server_key: "3174eed471b7712d42a5e20138442f39"
server_key_iv: "c6e432af6ac62726e4585349b51af6a1"
server_key_version: "encryptionkey@0"
I20260808 23:38:37.160540 17158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:37.167366 17158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:37.172178 17158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:37.172525 17158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:37.193091 17158 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45583
I20260808 23:38:37.193248 17228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45583 every 8 connection(s)
I20260808 23:38:37.194651 17158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:37.198757 17229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:37.203743 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 17158
I20260808 23:38:37.203958 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:37.204541 27455 external_mini_cluster.cc:1428] Setting key 1b5ec4fe5b9d5b07688fc82b126e0513
I20260808 23:38:37.212327 17229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7: Bootstrap starting.
I20260808 23:38:37.215162 17232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:37.207583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49347 (local address 127.0.0.1:45583)
0808 23:38:37.209052 (+ 1469us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:37.209069 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:37.209128 (+ 59us) server_negotiation.cc:407] Connection header received
0808 23:38:37.211069 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:37.211101 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:37.211551 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:37.211978 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:37.213379 (+ 1401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:37.213386 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:37.213401 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:37.213418 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:37.213484 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:37.213505 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:37.213710 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:37.213813 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 23:38:37.214052 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1129,"thread_start_us":780,"threads_started":1}
I20260808 23:38:37.217145 17229 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:37.218576 17229 log.cc:824] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:37.221118 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:38:37.223184 17229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7: No bootstrap required, opened a new log
I20260808 23:38:37.229748 17232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:37.226881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40039 (local address 127.0.0.1:45583)
0808 23:38:37.227131 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:37.227139 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:37.227528 (+ 389us) server_negotiation.cc:407] Connection header received
0808 23:38:37.227713 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:37.227717 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:37.227779 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:37.227872 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:37.228957 (+ 1085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:37.228961 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:37.228964 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:37.228981 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:37.229029 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:37.229045 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:37.229146 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:37.229302 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 23:38:37.229363 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260808 23:38:37.233632 17229 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71becc8b726a4920bf6436799640ced7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45583 } }
I20260808 23:38:37.234108 17229 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:37.234241 17229 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71becc8b726a4920bf6436799640ced7, State: Initialized, Role: FOLLOWER
I20260808 23:38:37.234890 17229 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71becc8b726a4920bf6436799640ced7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45583 } }
I20260808 23:38:37.235155 17229 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:37.235330 17229 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:37.235524 17229 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:37.238178 17229 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71becc8b726a4920bf6436799640ced7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45583 } }
I20260808 23:38:37.238775 17229 leader_election.cc:302] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71becc8b726a4920bf6436799640ced7; no voters:
I20260808 23:38:37.239423 17229 leader_election.cc:288] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:37.239598 17239 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:37.241132 17239 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [term 1 LEADER]: Becoming Leader. State: Replica: 71becc8b726a4920bf6436799640ced7, State: Running, Role: LEADER
I20260808 23:38:37.241850 17239 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71becc8b726a4920bf6436799640ced7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45583 } }
I20260808 23:38:37.242180 17229 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:37.245126 17241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71becc8b726a4920bf6436799640ced7. Latest consensus state: current_term: 1 leader_uuid: "71becc8b726a4920bf6436799640ced7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71becc8b726a4920bf6436799640ced7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45583 } } }
I20260808 23:38:37.245623 17241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:37.246237 17240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71becc8b726a4920bf6436799640ced7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71becc8b726a4920bf6436799640ced7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45583 } } }
I20260808 23:38:37.246572 17240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:37.246915 17249 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:37.253556 17249 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:37.263563 17249 catalog_manager.cc:1347] Generated new cluster ID: 56be4b1c031748fbbf6a413ff44566bc
I20260808 23:38:37.263737 17249 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:37.273572 17249 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:37.274237 17249 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:37.291756 17249 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71becc8b726a4920bf6436799640ced7: Generated new TSK 0
I20260808 23:38:37.292821 17249 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:38:37.298137 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 17158
W20260808 23:38:37.299427 17224 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49347
W20260808 23:38:37.300248 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 17158: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:38:37.300410 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 17158
2026-08-08T23:38:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2154 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:37 dist-test-slave-1x4g krb5kdc[17261](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:37 dist-test-slave-1x4g krb5kdc[17261](info): set up 2 sockets
Aug 08 23:38:37 dist-test-slave-1x4g krb5kdc[17261](info): commencing operation
krb5kdc: starting...
W20260808 23:38:38.505617 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.007s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:38:38 dist-test-slave-1x4g krb5kdc[17261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:38:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 23:38:38.877169 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37403
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37403
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:39.255548 17274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:39.255963 17274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:39.256145 17274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:39.264217 17274 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:39.264369 17274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:39.264470 17274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:39.264590 17274 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:39.264679 17274 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:39.275444 17274 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37403
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:39.277046 17274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:39.278513 17274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:39.292186 17282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:39.292136 17280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:39.292241 17279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:39.293182 17274 server_base.cc:1034] running on GCE node
I20260808 23:38:39.294117 17274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:39.295799 17274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:39.297039 17274 hybrid_clock.cc:648] HybridClock initialized: now 1786232319296970 us; error 69 us; skew 500 ppm
I20260808 23:38:39.297498 17274 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:39 dist-test-slave-1x4g krb5kdc[17261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232319, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:39.305065 17274 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 23:38:39.307003 17274 webserver.cc:460] Webserver started at http://127.0.0.1:36625/ using document root <none> and password file <none>
I20260808 23:38:39.307787 17274 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:39.307914 17274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:39.308220 17274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:39.311722 17274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "354f78f0a0e5486d8b43455a9e9156d5"
format_stamp: "Formatted at 2026-08-08 23:38:39 on dist-test-slave-1x4g"
server_key: "95c52f1820681ae228afbd303ce533d2"
server_key_iv: "4c4509336a7be3d594e09ad82c4feb0d"
server_key_version: "encryptionkey@0"
I20260808 23:38:39.312624 17274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "354f78f0a0e5486d8b43455a9e9156d5"
format_stamp: "Formatted at 2026-08-08 23:38:39 on dist-test-slave-1x4g"
server_key: "95c52f1820681ae228afbd303ce533d2"
server_key_iv: "4c4509336a7be3d594e09ad82c4feb0d"
server_key_version: "encryptionkey@0"
I20260808 23:38:39.318682 17274 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260808 23:38:39.322964 17290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:39.324558 17274 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 23:38:39.324812 17274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "354f78f0a0e5486d8b43455a9e9156d5"
format_stamp: "Formatted at 2026-08-08 23:38:39 on dist-test-slave-1x4g"
server_key: "95c52f1820681ae228afbd303ce533d2"
server_key_iv: "4c4509336a7be3d594e09ad82c4feb0d"
server_key_version: "encryptionkey@0"
I20260808 23:38:39.325065 17274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:39.342312 17274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:39.347389 17274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:39.347738 17274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:39.370175 17274 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37403
I20260808 23:38:39.370188 17343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37403 every 8 connection(s)
I20260808 23:38:39.371866 17274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:39.374500 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 17274
I20260808 23:38:39.374709 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:39.375284 27455 external_mini_cluster.cc:1428] Setting key bfef05320a4230c80285971a16cf19f8
I20260808 23:38:39.376835 17344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 23:38:39 dist-test-slave-1x4g krb5kdc[17261](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 23:38:39.391449 17344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5: Bootstrap starting.
I20260808 23:38:39.395744 17344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:39.397279 17344 log.cc:824] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:39.401058 17344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5: No bootstrap required, opened a new log
I20260808 23:38:39.402424 17347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:39.377562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48505 (local address 127.0.0.1:37403)
0808 23:38:39.378496 (+ 934us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:39.378510 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:39.378560 (+ 50us) server_negotiation.cc:407] Connection header received
0808 23:38:39.380614 (+ 2054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:39.380645 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:39.381263 (+ 618us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:39.381832 (+ 569us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:39.383580 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:39.385125 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:39.386556 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:39.387351 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:39.387607 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:39.392887 (+ 5280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:39.392900 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:39.392917 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:39.392979 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:39.396770 (+ 3791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:39.397914 (+ 1144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:39.397930 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:39.397944 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:39.398260 (+ 316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:39.398802 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:39.398812 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:39.398818 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:39.399475 (+ 657us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:39.399836 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:39.400400 (+ 564us) server_negotiation.cc:299] Negotiation successful
0808 23:38:39.401009 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":421,"threads_started":1}
I20260808 23:38:39.407868 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:38:39.411424 17344 raft_consensus.cc:348] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354f78f0a0e5486d8b43455a9e9156d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37403 } }
I20260808 23:38:39.412148 17344 raft_consensus.cc:374] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:39.412305 17344 raft_consensus.cc:729] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354f78f0a0e5486d8b43455a9e9156d5, State: Initialized, Role: FOLLOWER
I20260808 23:38:39.413177 17344 consensus_queue.cc:260] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354f78f0a0e5486d8b43455a9e9156d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37403 } }
I20260808 23:38:39.413596 17344 raft_consensus.cc:388] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:39.413846 17344 raft_consensus.cc:482] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:39.414090 17344 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:39.417095 17344 raft_consensus.cc:504] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354f78f0a0e5486d8b43455a9e9156d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37403 } }
I20260808 23:38:39.417887 17344 leader_election.cc:302] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 354f78f0a0e5486d8b43455a9e9156d5; no voters:
I20260808 23:38:39.418740 17344 leader_election.cc:288] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:39.418932 17355 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:39.420974 17355 raft_consensus.cc:686] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [term 1 LEADER]: Becoming Leader. State: Replica: 354f78f0a0e5486d8b43455a9e9156d5, State: Running, Role: LEADER
I20260808 23:38:39.422171 17344 sys_catalog.cc:564] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:39.422039 17355 consensus_queue.cc:237] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354f78f0a0e5486d8b43455a9e9156d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37403 } }
I20260808 23:38:39.428340 17357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 354f78f0a0e5486d8b43455a9e9156d5. Latest consensus state: current_term: 1 leader_uuid: "354f78f0a0e5486d8b43455a9e9156d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354f78f0a0e5486d8b43455a9e9156d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37403 } } }
I20260808 23:38:39.428890 17357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:39.429885 17356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "354f78f0a0e5486d8b43455a9e9156d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354f78f0a0e5486d8b43455a9e9156d5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37403 } } }
I20260808 23:38:39.430371 17356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:39.438709 17347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:39.413512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60327 (local address 127.0.0.1:37403)
0808 23:38:39.413756 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:39.413764 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:39.414327 (+ 563us) server_negotiation.cc:407] Connection header received
0808 23:38:39.414540 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:39.414547 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:39.414667 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:39.414815 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:39.416960 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:39.418151 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:39.420630 (+ 2479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:39.421594 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:39.421784 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:39.426508 (+ 4724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:39.426518 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:39.426527 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:39.426609 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:39.432612 (+ 6003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:39.434112 (+ 1500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:39.434122 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:39.434128 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:39.434360 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:39.435039 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:39.435047 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:39.435053 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:39.435554 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:39.437456 (+ 1902us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:39.437685 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 23:38:39.438084 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 23:38:39.442090 17365 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:39.448225 17365 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:39.459266 17365 catalog_manager.cc:1347] Generated new cluster ID: 7cb3105f2fc646979821eb0fa0dddb6f
I20260808 23:38:39.459470 17365 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:39.483126 17365 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:39.485096 17365 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:39.493387 17365 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 354f78f0a0e5486d8b43455a9e9156d5: Generated new TSK 0
I20260808 23:38:39.494375 17365 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:38:39.500663 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 17274
I20260808 23:38:39.502218 17339 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:39.598263 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 17274
2026-08-08T23:38:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2298 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:39 dist-test-slave-1x4g krb5kdc[17379](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:39 dist-test-slave-1x4g krb5kdc[17379](info): set up 2 sockets
Aug 08 23:38:39 dist-test-slave-1x4g krb5kdc[17379](info): commencing operation
krb5kdc: starting...
W20260808 23:38:40.793283 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.000s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:38:41 dist-test-slave-1x4g krb5kdc[17379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:38:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 23:38:41.173448 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42557
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42557
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:41.565191 17393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:41.565575 17393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:41.565757 17393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:41.573246 17393 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:41.573431 17393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:41.573549 17393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:41.573664 17393 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:41.573753 17393 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:41.584251 17393 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:41.585842 17393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:41.587414 17393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:41.600683 17401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:41.600742 17399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:41.601099 17398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:41.602237 17393 server_base.cc:1034] running on GCE node
I20260808 23:38:41.603188 17393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:41.605011 17393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:41.606288 17393 hybrid_clock.cc:648] HybridClock initialized: now 1786232321606247 us; error 66 us; skew 500 ppm
I20260808 23:38:41.606698 17393 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:41 dist-test-slave-1x4g krb5kdc[17379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232321, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:41.610390 17393 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 23:38:41.612183 17393 webserver.cc:460] Webserver started at http://127.0.0.1:40811/ using document root <none> and password file <none>
I20260808 23:38:41.612991 17393 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:41.613121 17393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:41.613405 17393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:41.616714 17393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "1e3ddd75d6ba40808058a5d053d7720e"
format_stamp: "Formatted at 2026-08-08 23:38:41 on dist-test-slave-1x4g"
server_key: "9b7ece52ed05c501dcb34a78182ae187"
server_key_iv: "5b9ff31bd4de7eb6ab0db4877929994a"
server_key_version: "encryptionkey@0"
I20260808 23:38:41.617686 17393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "1e3ddd75d6ba40808058a5d053d7720e"
format_stamp: "Formatted at 2026-08-08 23:38:41 on dist-test-slave-1x4g"
server_key: "9b7ece52ed05c501dcb34a78182ae187"
server_key_iv: "5b9ff31bd4de7eb6ab0db4877929994a"
server_key_version: "encryptionkey@0"
I20260808 23:38:41.623690 17393 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 23:38:41.628032 17408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:41.629772 17393 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:38:41.629972 17393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "1e3ddd75d6ba40808058a5d053d7720e"
format_stamp: "Formatted at 2026-08-08 23:38:41 on dist-test-slave-1x4g"
server_key: "9b7ece52ed05c501dcb34a78182ae187"
server_key_iv: "5b9ff31bd4de7eb6ab0db4877929994a"
server_key_version: "encryptionkey@0"
I20260808 23:38:41.630203 17393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:41.657486 17393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:41.662797 17393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:41.663086 17393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:41.683820 17393 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42557
I20260808 23:38:41.683861 17461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42557 every 8 connection(s)
I20260808 23:38:41.685456 17393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:41.689846 17462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:41.693143 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 17393
I20260808 23:38:41.693347 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:41.693895 27455 external_mini_cluster.cc:1428] Setting key b154e478c72fef2bf69960523200cbad
I20260808 23:38:41.703780 17462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e: Bootstrap starting.
I20260808 23:38:41.708210 17462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:41.709676 17462 log.cc:824] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:41.710748 17465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:41.696466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56965 (local address 127.0.0.1:42557)
0808 23:38:41.697490 (+ 1024us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:41.697503 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:41.697550 (+ 47us) server_negotiation.cc:407] Connection header received
0808 23:38:41.699359 (+ 1809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:41.699388 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:41.699896 (+ 508us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:41.700298 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:41.701110 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:41.702547 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:41.704547 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:41.705362 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:41.705536 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:41.707095 (+ 1559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:41.707105 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:41.707127 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:41.707747 (+ 620us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:41.707837 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:41.707866 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:41.707986 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:41.708463 (+ 477us) server_negotiation.cc:299] Negotiation successful
0808 23:38:41.708911 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":764,"thread_start_us":507,"threads_started":1}
I20260808 23:38:41.713621 17462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e: No bootstrap required, opened a new log
I20260808 23:38:41.715298 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:38:41.726311 17462 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3ddd75d6ba40808058a5d053d7720e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } }
I20260808 23:38:41.726970 17462 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:41.727129 17462 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3ddd75d6ba40808058a5d053d7720e, State: Initialized, Role: FOLLOWER
I20260808 23:38:41.728024 17462 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3ddd75d6ba40808058a5d053d7720e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } }
I20260808 23:38:41.728386 17462 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:41.728554 17462 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:41.728892 17462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:41.730201 17465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:41.721712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33079 (local address 127.0.0.1:42557)
0808 23:38:41.721970 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:41.721977 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:41.722342 (+ 365us) server_negotiation.cc:407] Connection header received
0808 23:38:41.722583 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:41.722588 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:41.722672 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:41.722764 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:41.723508 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:41.724270 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:41.726516 (+ 2246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:41.727206 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:41.727368 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:41.728913 (+ 1545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:41.728922 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:41.728929 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:41.728960 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:41.729023 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:41.729055 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:41.729181 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:41.729301 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 23:38:41.729620 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260808 23:38:41.732847 17462 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3ddd75d6ba40808058a5d053d7720e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } }
I20260808 23:38:41.733472 17462 leader_election.cc:302] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e3ddd75d6ba40808058a5d053d7720e; no voters:
I20260808 23:38:41.734163 17462 leader_election.cc:288] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:41.734238 17472 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:41.735942 17472 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [term 1 LEADER]: Becoming Leader. State: Replica: 1e3ddd75d6ba40808058a5d053d7720e, State: Running, Role: LEADER
I20260808 23:38:41.736570 17472 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3ddd75d6ba40808058a5d053d7720e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } }
I20260808 23:38:41.736821 17462 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:41.740423 17473 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e3ddd75d6ba40808058a5d053d7720e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3ddd75d6ba40808058a5d053d7720e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } } }
I20260808 23:38:41.740417 17474 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e3ddd75d6ba40808058a5d053d7720e. Latest consensus state: current_term: 1 leader_uuid: "1e3ddd75d6ba40808058a5d053d7720e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3ddd75d6ba40808058a5d053d7720e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } } }
I20260808 23:38:41.741020 17473 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:41.741089 17474 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:41.743319 17479 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:41.749439 17479 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:41.760602 17479 catalog_manager.cc:1347] Generated new cluster ID: ab3b20aa16fe482c98f49482cee8e7bf
I20260808 23:38:41.760809 17479 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:41.776895 17479 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:41.778436 17479 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:41.799033 17479 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e3ddd75d6ba40808058a5d053d7720e: Generated new TSK 0
I20260808 23:38:41.800097 17479 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:38:41.814550 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 17393
W20260808 23:38:41.815977 17457 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56965
W20260808 23:38:41.816876 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 17393: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:38:41.817049 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 17393
2026-08-08T23:38:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2218 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:41 dist-test-slave-1x4g krb5kdc[17493](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:41 dist-test-slave-1x4g krb5kdc[17493](info): set up 2 sockets
Aug 08 23:38:41 dist-test-slave-1x4g krb5kdc[17493](info): commencing operation
krb5kdc: starting...
W20260808 23:38:43.017472 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.005s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:38:43 dist-test-slave-1x4g krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:38:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 23:38:43.393112 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44987
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:43.774178 17506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:43.774557 17506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:43.774729 17506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:43.782505 17506 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:43.782697 17506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:43.782820 17506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:43.782938 17506 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:43.783020 17506 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:43.794065 17506 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:43.795634 17506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:43.797163 17506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:43.810889 17513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:43.810982 17512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:43.810978 17515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:43.812004 17506 server_base.cc:1034] running on GCE node
I20260808 23:38:43.813035 17506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:43.814682 17506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:43.816006 17506 hybrid_clock.cc:648] HybridClock initialized: now 1786232323815943 us; error 53 us; skew 500 ppm
I20260808 23:38:43.816496 17506 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:43 dist-test-slave-1x4g krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232323, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:43.820494 17506 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 23:38:43.822453 17506 webserver.cc:460] Webserver started at http://127.0.0.1:35777/ using document root <none> and password file <none>
I20260808 23:38:43.823276 17506 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:43.823468 17506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:43.823876 17506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:43.827764 17506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "0376297e9e644a87af777b3e4db06697"
format_stamp: "Formatted at 2026-08-08 23:38:43 on dist-test-slave-1x4g"
server_key: "c2c1eae44650056a14e04702ce98c7a0"
server_key_iv: "a0ca1239e263528ab0738030dd10c648"
server_key_version: "encryptionkey@0"
I20260808 23:38:43.828907 17506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "0376297e9e644a87af777b3e4db06697"
format_stamp: "Formatted at 2026-08-08 23:38:43 on dist-test-slave-1x4g"
server_key: "c2c1eae44650056a14e04702ce98c7a0"
server_key_iv: "a0ca1239e263528ab0738030dd10c648"
server_key_version: "encryptionkey@0"
I20260808 23:38:43.835510 17506 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 23:38:43.840066 17522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:43.841707 17506 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:38:43.841938 17506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "0376297e9e644a87af777b3e4db06697"
format_stamp: "Formatted at 2026-08-08 23:38:43 on dist-test-slave-1x4g"
server_key: "c2c1eae44650056a14e04702ce98c7a0"
server_key_iv: "a0ca1239e263528ab0738030dd10c648"
server_key_version: "encryptionkey@0"
I20260808 23:38:43.842186 17506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:43.848721 17506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:43.853709 17506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:43.854071 17506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:43.874264 17506 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44987
I20260808 23:38:43.874325 17576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44987 every 8 connection(s)
I20260808 23:38:43.875878 17506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:43.880095 17577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:43.880654 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 17506
I20260808 23:38:43.880875 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:43.881388 27455 external_mini_cluster.cc:1428] Setting key e8ebc0ce6c7a2f403eca6d28e4b2ed8a
I20260808 23:38:43.891774 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:43.883390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59361 (local address 127.0.0.1:44987)
0808 23:38:43.884350 (+ 960us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:43.884367 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:43.884423 (+ 56us) server_negotiation.cc:407] Connection header received
0808 23:38:43.887534 (+ 3111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:43.887569 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:43.888121 (+ 552us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:43.888633 (+ 512us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:43.889706 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:43.889714 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:43.889731 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:43.889750 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:43.889820 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:43.889852 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:43.890100 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:43.890227 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 23:38:43.890452 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":374,"threads_started":1}
I20260808 23:38:43.896252 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:38:43.896510 17577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697: Bootstrap starting.
I20260808 23:38:43.901042 17577 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:43.902611 17577 log.cc:824] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:43.905071 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:43.901947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52187 (local address 127.0.0.1:44987)
0808 23:38:43.902210 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:43.902220 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:43.902668 (+ 448us) server_negotiation.cc:407] Connection header received
0808 23:38:43.902907 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:43.902911 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:43.902968 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:43.903062 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:43.904308 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:43.904312 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:43.904315 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:43.904331 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:43.904372 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:43.904388 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:43.904489 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:43.904642 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 23:38:43.904697 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 23:38:43.906656 17577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697: No bootstrap required, opened a new log
I20260808 23:38:43.914794 17577 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0376297e9e644a87af777b3e4db06697" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44987 } }
I20260808 23:38:43.915302 17577 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:43.915426 17577 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0376297e9e644a87af777b3e4db06697, State: Initialized, Role: FOLLOWER
I20260808 23:38:43.916112 17577 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0376297e9e644a87af777b3e4db06697" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44987 } }
I20260808 23:38:43.916392 17577 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:43.916565 17577 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:43.916810 17577 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:43.919483 17577 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0376297e9e644a87af777b3e4db06697" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44987 } }
I20260808 23:38:43.920087 17577 leader_election.cc:302] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0376297e9e644a87af777b3e4db06697; no voters:
I20260808 23:38:43.920743 17577 leader_election.cc:288] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:43.920979 17588 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:43.921731 17588 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [term 1 LEADER]: Becoming Leader. State: Replica: 0376297e9e644a87af777b3e4db06697, State: Running, Role: LEADER
I20260808 23:38:43.922435 17588 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0376297e9e644a87af777b3e4db06697" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44987 } }
I20260808 23:38:43.923285 17577 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:43.925496 17589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0376297e9e644a87af777b3e4db06697" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0376297e9e644a87af777b3e4db06697" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44987 } } }
I20260808 23:38:43.926060 17589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:43.925611 17590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0376297e9e644a87af777b3e4db06697. Latest consensus state: current_term: 1 leader_uuid: "0376297e9e644a87af777b3e4db06697" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0376297e9e644a87af777b3e4db06697" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44987 } } }
I20260808 23:38:43.926992 17590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:43.929392 17597 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:43.935855 17597 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:43.946962 17597 catalog_manager.cc:1347] Generated new cluster ID: 90f42c7a9bdd415a992afb18882cc4d1
I20260808 23:38:43.947121 17597 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:43.982602 17597 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:43.983139 17597 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:43.990609 17597 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0376297e9e644a87af777b3e4db06697: Generated new TSK 0
I20260808 23:38:43.991806 17597 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:38:44.010842 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 17506
W20260808 23:38:44.012185 17572 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:59361
W20260808 23:38:44.013139 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 17506: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:38:44.013336 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 17506
2026-08-08T23:38:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2195 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:44 dist-test-slave-1x4g krb5kdc[17611](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:44 dist-test-slave-1x4g krb5kdc[17611](info): set up 2 sockets
Aug 08 23:38:44 dist-test-slave-1x4g krb5kdc[17611](info): commencing operation
krb5kdc: starting...
W20260808 23:38:45.238433 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.004s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:38:45 dist-test-slave-1x4g krb5kdc[17611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232325, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:38:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 23:38:45.617954 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34175
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34175
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:46.000921 17625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:46.001248 17625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:46.001430 17625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:46.009881 17625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:46.010027 17625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:46.010115 17625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:46.010214 17625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:46.010298 17625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:46.021205 17625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:46.022718 17625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:46.024183 17625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:46.037616 17630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:46.037680 17631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:46.037933 17633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:46.038889 17625 server_base.cc:1034] running on GCE node
I20260808 23:38:46.039867 17625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:46.041718 17625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:46.043001 17625 hybrid_clock.cc:648] HybridClock initialized: now 1786232326042940 us; error 61 us; skew 500 ppm
I20260808 23:38:46.043449 17625 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:46 dist-test-slave-1x4g krb5kdc[17611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232326, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:46.047188 17625 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 23:38:46.049043 17625 webserver.cc:460] Webserver started at http://127.0.0.1:41083/ using document root <none> and password file <none>
I20260808 23:38:46.049808 17625 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:46.049932 17625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:46.050235 17625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:46.053704 17625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "5c60b4ba11fa4d4e9773d10ff4be149b"
format_stamp: "Formatted at 2026-08-08 23:38:46 on dist-test-slave-1x4g"
server_key: "510fe69011de51ad18b818e44d80e244"
server_key_iv: "18d923b7a09bbd2fda8afa2148da0415"
server_key_version: "encryptionkey@0"
I20260808 23:38:46.054641 17625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "5c60b4ba11fa4d4e9773d10ff4be149b"
format_stamp: "Formatted at 2026-08-08 23:38:46 on dist-test-slave-1x4g"
server_key: "510fe69011de51ad18b818e44d80e244"
server_key_iv: "18d923b7a09bbd2fda8afa2148da0415"
server_key_version: "encryptionkey@0"
I20260808 23:38:46.060708 17625 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 23:38:46.064730 17641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:46.066444 17625 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:38:46.066649 17625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "5c60b4ba11fa4d4e9773d10ff4be149b"
format_stamp: "Formatted at 2026-08-08 23:38:46 on dist-test-slave-1x4g"
server_key: "510fe69011de51ad18b818e44d80e244"
server_key_iv: "18d923b7a09bbd2fda8afa2148da0415"
server_key_version: "encryptionkey@0"
I20260808 23:38:46.066852 17625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:46.089345 17625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:46.094199 17625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:46.094461 17625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:46.116895 17625 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34175
I20260808 23:38:46.117002 17695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34175 every 8 connection(s)
I20260808 23:38:46.118507 17625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:46.122789 17696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:46.126471 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 17625
I20260808 23:38:46.126699 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:46.127230 27455 external_mini_cluster.cc:1428] Setting key 7b25ccba3bf47b87329232ce67aac86e
I20260808 23:38:46.137986 17696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b: Bootstrap starting.
I20260808 23:38:46.142130 17696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:46.143464 17696 log.cc:824] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b: Log is configured to *not* fsync() on all Append() calls
Aug 08 23:38:46 dist-test-slave-1x4g krb5kdc[17611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232325, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 23:38:46.147096 17696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b: No bootstrap required, opened a new log
I20260808 23:38:46.154985 17699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:46.129703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:43569 (local address 127.0.0.1:34175)
0808 23:38:46.130610 (+ 907us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:46.130628 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:46.130687 (+ 59us) server_negotiation.cc:407] Connection header received
0808 23:38:46.133262 (+ 2575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:46.133302 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:46.133980 (+ 678us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:46.134528 (+ 548us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:46.136051 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:46.138212 (+ 2161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:46.139679 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:46.140863 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:46.141090 (+ 227us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:46.145975 (+ 4885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:46.145985 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:46.146002 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:46.146044 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:46.149815 (+ 3771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:46.150891 (+ 1076us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:46.150902 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:46.150918 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:46.151120 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:46.151720 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:46.151724 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:46.151726 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:46.152375 (+ 649us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:46.152805 (+ 430us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:46.153388 (+ 583us) server_negotiation.cc:299] Negotiation successful
0808 23:38:46.153779 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":368,"threads_started":1}
I20260808 23:38:46.156000 17696 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c60b4ba11fa4d4e9773d10ff4be149b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34175 } }
I20260808 23:38:46.156461 17696 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:46.156627 17696 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c60b4ba11fa4d4e9773d10ff4be149b, State: Initialized, Role: FOLLOWER
I20260808 23:38:46.157375 17696 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c60b4ba11fa4d4e9773d10ff4be149b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34175 } }
I20260808 23:38:46.157675 17696 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:46.157836 17696 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:46.158057 17696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:46.159715 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:38:46.160948 17696 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c60b4ba11fa4d4e9773d10ff4be149b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34175 } }
I20260808 23:38:46.161568 17696 leader_election.cc:302] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c60b4ba11fa4d4e9773d10ff4be149b; no voters:
I20260808 23:38:46.162309 17696 leader_election.cc:288] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:46.162503 17701 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:46.166273 17701 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [term 1 LEADER]: Becoming Leader. State: Replica: 5c60b4ba11fa4d4e9773d10ff4be149b, State: Running, Role: LEADER
I20260808 23:38:46.167253 17701 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c60b4ba11fa4d4e9773d10ff4be149b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34175 } }
I20260808 23:38:46.167514 17696 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:46.174188 17705 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c60b4ba11fa4d4e9773d10ff4be149b. Latest consensus state: current_term: 1 leader_uuid: "5c60b4ba11fa4d4e9773d10ff4be149b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c60b4ba11fa4d4e9773d10ff4be149b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34175 } } }
I20260808 23:38:46.174083 17703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c60b4ba11fa4d4e9773d10ff4be149b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c60b4ba11fa4d4e9773d10ff4be149b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34175 } } }
I20260808 23:38:46.174634 17705 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:46.174703 17703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:46.188045 17714 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:46.194090 17714 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:46.195030 17699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:46.168467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:44845 (local address 127.0.0.1:34175)
0808 23:38:46.168645 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:46.168649 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:46.169394 (+ 745us) server_negotiation.cc:407] Connection header received
0808 23:38:46.169780 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:46.169790 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:46.169910 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:46.170019 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:46.172952 (+ 2933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:46.174760 (+ 1808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:46.177630 (+ 2870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:46.178642 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:46.178799 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:46.183600 (+ 4801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:46.183612 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:46.183620 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:46.183689 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:46.188956 (+ 5267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:46.190355 (+ 1399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:46.190365 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:46.190371 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:46.190600 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:46.191443 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:46.191451 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:46.191458 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:46.192086 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:46.192480 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:46.194152 (+ 1672us) server_negotiation.cc:299] Negotiation successful
0808 23:38:46.194444 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 23:38:46.205719 17714 catalog_manager.cc:1347] Generated new cluster ID: 81fb5fcdb44d4614bd61855fdcdf27c6
I20260808 23:38:46.205861 17714 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:46.259346 17714 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:46.261269 17714 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:46.282155 17714 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c60b4ba11fa4d4e9773d10ff4be149b: Generated new TSK 0
I20260808 23:38:46.283421 17714 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:38:46.300143 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 17625
I20260808 23:38:46.301726 17690 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:46.405274 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 17625
W20260808 23:38:46.428529 17609 connection.cc:535] client connection to 127.0.0.1:34175 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34175): Connection reset by peer (error 104)
2026-08-08T23:38:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2392 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:46 dist-test-slave-1x4g krb5kdc[17729](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:46 dist-test-slave-1x4g krb5kdc[17729](info): set up 2 sockets
Aug 08 23:38:46 dist-test-slave-1x4g krb5kdc[17729](info): commencing operation
krb5kdc: starting...
W20260808 23:38:47.610937 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.003s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:38:47 dist-test-slave-1x4g krb5kdc[17729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232327, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:38:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 23:38:47.986503 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33511
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33511
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:48.365331 17742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:48.365684 17742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:48.365864 17742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:48.373543 17742 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:48.373679 17742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:48.373783 17742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:48.373906 17742 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:48.373975 17742 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:48.385232 17742 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33511
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:48.386759 17742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:48.388240 17742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:48.402441 17747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:48.402390 17748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:48.402420 17750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:48.403657 17742 server_base.cc:1034] running on GCE node
I20260808 23:38:48.404671 17742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:48.406512 17742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:48.407750 17742 hybrid_clock.cc:648] HybridClock initialized: now 1786232328407699 us; error 60 us; skew 500 ppm
I20260808 23:38:48.408187 17742 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:48 dist-test-slave-1x4g krb5kdc[17729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232328, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:48.411984 17742 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 23:38:48.413902 17742 webserver.cc:460] Webserver started at http://127.0.0.1:44249/ using document root <none> and password file <none>
I20260808 23:38:48.414714 17742 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:48.414883 17742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:48.415236 17742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:48.418834 17742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "c31318f4598e40239f7629f621dbcea4"
format_stamp: "Formatted at 2026-08-08 23:38:48 on dist-test-slave-1x4g"
server_key: "c94e89891bd78403183c7e527a211345"
server_key_iv: "b9f7169744e5df7e5b1561a8e48aae7f"
server_key_version: "encryptionkey@0"
I20260808 23:38:48.419801 17742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "c31318f4598e40239f7629f621dbcea4"
format_stamp: "Formatted at 2026-08-08 23:38:48 on dist-test-slave-1x4g"
server_key: "c94e89891bd78403183c7e527a211345"
server_key_iv: "b9f7169744e5df7e5b1561a8e48aae7f"
server_key_version: "encryptionkey@0"
I20260808 23:38:48.426119 17742 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 23:38:48.430277 17758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:48.431871 17742 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260808 23:38:48.432132 17742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "c31318f4598e40239f7629f621dbcea4"
format_stamp: "Formatted at 2026-08-08 23:38:48 on dist-test-slave-1x4g"
server_key: "c94e89891bd78403183c7e527a211345"
server_key_iv: "b9f7169744e5df7e5b1561a8e48aae7f"
server_key_version: "encryptionkey@0"
I20260808 23:38:48.432381 17742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:48.466770 17742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:48.473299 17742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:48.473706 17742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:48.495025 17742 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33511
I20260808 23:38:48.495087 17814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33511 every 8 connection(s)
I20260808 23:38:48.496735 17742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:48.501534 17815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:48.506433 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 17742
I20260808 23:38:48.506717 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:48.507298 27455 external_mini_cluster.cc:1428] Setting key e364a3a331fdae2932165478500b396f
I20260808 23:38:48.517771 17815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4: Bootstrap starting.
I20260808 23:38:48.522222 17815 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:48.523535 17815 log.cc:824] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:48.524192 17818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:48.509641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:48277 (local address 127.0.0.1:33511)
0808 23:38:48.510581 (+ 940us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:48.510595 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:48.510644 (+ 49us) server_negotiation.cc:407] Connection header received
0808 23:38:48.512463 (+ 1819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:48.512496 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:48.513121 (+ 625us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:48.513534 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:48.514556 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:48.515992 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:48.518271 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:48.519102 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:48.519287 (+ 185us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:48.520975 (+ 1688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:48.520985 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:48.521019 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:48.521644 (+ 625us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:48.521747 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:48.521778 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:48.521925 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:48.522517 (+ 592us) server_negotiation.cc:299] Negotiation successful
0808 23:38:48.522763 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":695,"thread_start_us":425,"threads_started":1}
I20260808 23:38:48.527352 17815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4: No bootstrap required, opened a new log
I20260808 23:38:48.529076 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:38:48.536903 17815 raft_consensus.cc:348] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c31318f4598e40239f7629f621dbcea4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } }
I20260808 23:38:48.537496 17815 raft_consensus.cc:374] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:48.537654 17815 raft_consensus.cc:729] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c31318f4598e40239f7629f621dbcea4, State: Initialized, Role: FOLLOWER
I20260808 23:38:48.538369 17815 consensus_queue.cc:260] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c31318f4598e40239f7629f621dbcea4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } }
I20260808 23:38:48.538664 17815 raft_consensus.cc:388] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:48.538837 17815 raft_consensus.cc:482] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:48.539064 17815 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:48.541884 17818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:48.534138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:39551 (local address 127.0.0.1:33511)
0808 23:38:48.534371 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:48.534378 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:48.534700 (+ 322us) server_negotiation.cc:407] Connection header received
0808 23:38:48.534883 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:48.534891 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:48.534994 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:48.535139 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:48.535776 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:48.537047 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:48.538849 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:48.539456 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:48.539614 (+ 158us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:48.541018 (+ 1404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:48.541023 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:48.541026 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:48.541052 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:48.541122 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:48.541140 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:48.541292 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:48.541527 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 23:38:48.541592 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 23:38:48.542441 17815 raft_consensus.cc:504] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c31318f4598e40239f7629f621dbcea4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } }
I20260808 23:38:48.543077 17815 leader_election.cc:302] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c31318f4598e40239f7629f621dbcea4; no voters:
I20260808 23:38:48.543856 17815 leader_election.cc:288] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:48.543953 17825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:48.544860 17825 raft_consensus.cc:686] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [term 1 LEADER]: Becoming Leader. State: Replica: c31318f4598e40239f7629f621dbcea4, State: Running, Role: LEADER
I20260808 23:38:48.545526 17825 consensus_queue.cc:237] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c31318f4598e40239f7629f621dbcea4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } }
I20260808 23:38:48.546339 17815 sys_catalog.cc:564] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:48.548936 17827 sys_catalog.cc:455] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c31318f4598e40239f7629f621dbcea4. Latest consensus state: current_term: 1 leader_uuid: "c31318f4598e40239f7629f621dbcea4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c31318f4598e40239f7629f621dbcea4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } } }
I20260808 23:38:48.549374 17827 sys_catalog.cc:458] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:48.550762 17826 sys_catalog.cc:455] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c31318f4598e40239f7629f621dbcea4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c31318f4598e40239f7629f621dbcea4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } } }
I20260808 23:38:48.551236 17826 sys_catalog.cc:458] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:48.552547 17832 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:48.558893 17832 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:48.569147 17832 catalog_manager.cc:1347] Generated new cluster ID: 34b486d731c143bf99a280f3871566a8
I20260808 23:38:48.569299 17832 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:48.591919 17832 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:48.593446 17832 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:48.603857 17832 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c31318f4598e40239f7629f621dbcea4: Generated new TSK 0
I20260808 23:38:48.605002 17832 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:38:48.612332 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 17742
W20260808 23:38:48.613883 17810 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.163:48277
W20260808 23:38:48.614763 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 17742: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:38:48.614941 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 17742
W20260808 23:38:48.637553 17727 connection.cc:535] client connection to 127.0.0.1:33511 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33511): Connection reset by peer (error 104)
2026-08-08T23:38:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2208 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:48 dist-test-slave-1x4g krb5kdc[17847](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:48 dist-test-slave-1x4g krb5kdc[17847](info): set up 2 sockets
Aug 08 23:38:48 dist-test-slave-1x4g krb5kdc[17847](info): commencing operation
krb5kdc: starting...
W20260808 23:38:49.809999 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.007s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:38:50 dist-test-slave-1x4g krb5kdc[17847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:38:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 23:38:50.193558 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38927
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:50.576349 17860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:50.576740 17860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:50.576956 17860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:50.585379 17860 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:50.585546 17860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:50.585659 17860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:50.585779 17860 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:50.585865 17860 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:50.596902 17860 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:50.598421 17860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:50.599946 17860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:50.613428 17865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:50.613474 17866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:50.613726 17868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:50.614467 17860 server_base.cc:1034] running on GCE node
I20260808 23:38:50.615482 17860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:50.617415 17860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:50.618717 17860 hybrid_clock.cc:648] HybridClock initialized: now 1786232330618659 us; error 42 us; skew 500 ppm
I20260808 23:38:50.619226 17860 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:50 dist-test-slave-1x4g krb5kdc[17847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232330, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:50.629434 17860 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 23:38:50.631572 17860 webserver.cc:460] Webserver started at http://127.0.0.1:33267/ using document root <none> and password file <none>
I20260808 23:38:50.632436 17860 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:50.632632 17860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:50.633070 17860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:50.636618 17860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "8bc9dbab39554ef4a1d88cfc54369574"
format_stamp: "Formatted at 2026-08-08 23:38:50 on dist-test-slave-1x4g"
server_key: "a10cb221acf638109203f7fd28486977"
server_key_iv: "803ddeaeb94d78f5ab030f2e846e6aa1"
server_key_version: "encryptionkey@0"
I20260808 23:38:50.637673 17860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "8bc9dbab39554ef4a1d88cfc54369574"
format_stamp: "Formatted at 2026-08-08 23:38:50 on dist-test-slave-1x4g"
server_key: "a10cb221acf638109203f7fd28486977"
server_key_iv: "803ddeaeb94d78f5ab030f2e846e6aa1"
server_key_version: "encryptionkey@0"
I20260808 23:38:50.643774 17860 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 23:38:50.648013 17875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:50.649741 17860 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:38:50.649981 17860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "8bc9dbab39554ef4a1d88cfc54369574"
format_stamp: "Formatted at 2026-08-08 23:38:50 on dist-test-slave-1x4g"
server_key: "a10cb221acf638109203f7fd28486977"
server_key_iv: "803ddeaeb94d78f5ab030f2e846e6aa1"
server_key_version: "encryptionkey@0"
I20260808 23:38:50.650228 17860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:50.657068 17860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:50.661863 17860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:50.662235 17860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:50.683285 17860 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38927
I20260808 23:38:50.683337 17929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38927 every 8 connection(s)
I20260808 23:38:50.684911 17860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:50.689146 17930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:50.692968 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 17860
I20260808 23:38:50.693168 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:50.693778 27455 external_mini_cluster.cc:1428] Setting key 8b26980b86dc123ab829ddd70262435d
I20260808 23:38:50.702602 17933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:50.695916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:42625 (local address 127.0.0.1:38927)
0808 23:38:50.696762 (+ 846us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:50.696833 (+ 71us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:50.696882 (+ 49us) server_negotiation.cc:407] Connection header received
0808 23:38:50.698673 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:50.698701 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:50.699116 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:50.699569 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:50.700729 (+ 1160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:50.700736 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:50.700750 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:50.700766 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:50.700884 (+ 118us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:50.700909 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:50.701169 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:50.701318 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 23:38:50.701544 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":360,"threads_started":1}
I20260808 23:38:50.702790 17930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574: Bootstrap starting.
I20260808 23:38:50.706854 17930 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:50.707269 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:38:50.708129 17930 log.cc:824] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:50.711959 17930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574: No bootstrap required, opened a new log
I20260808 23:38:50.715863 17933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:50.712393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:37339 (local address 127.0.0.1:38927)
0808 23:38:50.712667 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:50.712682 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:50.713214 (+ 532us) server_negotiation.cc:407] Connection header received
0808 23:38:50.713475 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:50.713480 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:50.713539 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:50.713630 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:50.714891 (+ 1261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:50.714896 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:50.714900 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:50.714922 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:50.714977 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:50.714999 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:50.715117 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:50.715339 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 23:38:50.715425 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 23:38:50.724234 17930 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bc9dbab39554ef4a1d88cfc54369574" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38927 } }
I20260808 23:38:50.725296 17930 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:50.725803 17930 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bc9dbab39554ef4a1d88cfc54369574, State: Initialized, Role: FOLLOWER
I20260808 23:38:50.726745 17930 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bc9dbab39554ef4a1d88cfc54369574" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38927 } }
I20260808 23:38:50.727083 17930 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:50.727281 17930 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:50.727488 17930 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:50.730099 17930 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bc9dbab39554ef4a1d88cfc54369574" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38927 } }
I20260808 23:38:50.730891 17930 leader_election.cc:302] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8bc9dbab39554ef4a1d88cfc54369574; no voters:
I20260808 23:38:50.731639 17930 leader_election.cc:288] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:50.731827 17940 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:50.732694 17940 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [term 1 LEADER]: Becoming Leader. State: Replica: 8bc9dbab39554ef4a1d88cfc54369574, State: Running, Role: LEADER
I20260808 23:38:50.733314 17940 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bc9dbab39554ef4a1d88cfc54369574" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38927 } }
I20260808 23:38:50.734306 17930 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:50.736934 17942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8bc9dbab39554ef4a1d88cfc54369574. Latest consensus state: current_term: 1 leader_uuid: "8bc9dbab39554ef4a1d88cfc54369574" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bc9dbab39554ef4a1d88cfc54369574" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38927 } } }
I20260808 23:38:50.737568 17942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:50.738294 17941 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8bc9dbab39554ef4a1d88cfc54369574" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bc9dbab39554ef4a1d88cfc54369574" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38927 } } }
I20260808 23:38:50.740815 17941 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:50.742199 17948 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:50.748570 17948 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:50.760129 17948 catalog_manager.cc:1347] Generated new cluster ID: bcc72395f9a04b66b689c9901eb95ef1
I20260808 23:38:50.760288 17948 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:50.784852 17948 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:50.785470 17948 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:50.799459 17948 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8bc9dbab39554ef4a1d88cfc54369574: Generated new TSK 0
I20260808 23:38:50.800504 17948 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:38:50.816790 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 17860
W20260808 23:38:50.818114 17925 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.163:42625
W20260808 23:38:50.818900 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 17860: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:38:50.819072 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 17860
2026-08-08T23:38:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2204 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:50 dist-test-slave-1x4g krb5kdc[17961](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:50 dist-test-slave-1x4g krb5kdc[17961](info): set up 2 sockets
Aug 08 23:38:50 dist-test-slave-1x4g krb5kdc[17961](info): commencing operation
krb5kdc: starting...
W20260808 23:38:52.029315 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.004s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:38:52 dist-test-slave-1x4g krb5kdc[17961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:38:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 23:38:52.410760 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46479
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46479
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:52.789832 17974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:52.790180 17974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:52.790359 17974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:52.798203 17974 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:52.798344 17974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:52.798485 17974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:52.798569 17974 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:52.798641 17974 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:52.809376 17974 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46479
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:52.810941 17974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:52.812384 17974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:52.825604 17979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:52.825664 17982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:52.825686 17980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:52.826587 17974 server_base.cc:1034] running on GCE node
I20260808 23:38:52.827579 17974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:52.829393 17974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:52.830782 17974 hybrid_clock.cc:648] HybridClock initialized: now 1786232332830684 us; error 59 us; skew 500 ppm
I20260808 23:38:52.831262 17974 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:52 dist-test-slave-1x4g krb5kdc[17961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232332, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:52.836061 17974 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 23:38:52.839291 17974 webserver.cc:460] Webserver started at http://127.0.0.1:39365/ using document root <none> and password file <none>
I20260808 23:38:52.840132 17974 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:52.840314 17974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:52.840664 17974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:52.844101 17974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "29159da4a3d149079c3e29364eb25a7c"
format_stamp: "Formatted at 2026-08-08 23:38:52 on dist-test-slave-1x4g"
server_key: "bc82bb087b224d649c95dda896a76b4f"
server_key_iv: "de96ee8854a9a3eff1f1eeebd96766c0"
server_key_version: "encryptionkey@0"
I20260808 23:38:52.845113 17974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "29159da4a3d149079c3e29364eb25a7c"
format_stamp: "Formatted at 2026-08-08 23:38:52 on dist-test-slave-1x4g"
server_key: "bc82bb087b224d649c95dda896a76b4f"
server_key_iv: "de96ee8854a9a3eff1f1eeebd96766c0"
server_key_version: "encryptionkey@0"
I20260808 23:38:52.851254 17974 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 23:38:52.855715 17991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:52.857482 17974 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260808 23:38:52.857740 17974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "29159da4a3d149079c3e29364eb25a7c"
format_stamp: "Formatted at 2026-08-08 23:38:52 on dist-test-slave-1x4g"
server_key: "bc82bb087b224d649c95dda896a76b4f"
server_key_iv: "de96ee8854a9a3eff1f1eeebd96766c0"
server_key_version: "encryptionkey@0"
I20260808 23:38:52.858037 17974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:52.876427 17974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:52.881742 17974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:52.882097 17974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:52.902856 17974 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46479
I20260808 23:38:52.902889 18045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46479 every 8 connection(s)
I20260808 23:38:52.904515 17974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:52.909073 18046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:52.909828 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 17974
I20260808 23:38:52.910025 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:52.910650 27455 external_mini_cluster.cc:1428] Setting key 96a891225108674eb6bff782bc8d4165
I20260808 23:38:52.925000 18046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c: Bootstrap starting.
Aug 08 23:38:52 dist-test-slave-1x4g krb5kdc[17961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 23:38:52.929297 18046 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:52.930550 18046 log.cc:824] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:52.934473 18046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c: No bootstrap required, opened a new log
I20260808 23:38:52.938864 18050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:52.912744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:36009 (local address 127.0.0.1:46479)
0808 23:38:52.913710 (+ 966us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:52.913722 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:52.913770 (+ 48us) server_negotiation.cc:407] Connection header received
0808 23:38:52.915936 (+ 2166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:52.915989 (+ 53us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:52.916588 (+ 599us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:52.917060 (+ 472us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:52.919066 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:52.920667 (+ 1601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:52.922723 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:52.923564 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:52.923723 (+ 159us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:52.929114 (+ 5391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:52.929125 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:52.929144 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:52.929201 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:52.933254 (+ 4053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:52.934323 (+ 1069us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:52.934332 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:52.934343 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:52.934640 (+ 297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:52.935173 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:52.935178 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:52.935181 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:52.935969 (+ 788us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:52.936314 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:52.936840 (+ 526us) server_negotiation.cc:299] Negotiation successful
0808 23:38:52.937268 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":664,"thread_start_us":405,"threads_started":1}
I20260808 23:38:52.943674 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:38:52.945248 18046 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29159da4a3d149079c3e29364eb25a7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46479 } }
I20260808 23:38:52.945667 18046 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:52.945804 18046 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29159da4a3d149079c3e29364eb25a7c, State: Initialized, Role: FOLLOWER
I20260808 23:38:52.946477 18046 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29159da4a3d149079c3e29364eb25a7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46479 } }
I20260808 23:38:52.946755 18046 raft_consensus.cc:388] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:52.946935 18046 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:52.947136 18046 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:52.949986 18046 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29159da4a3d149079c3e29364eb25a7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46479 } }
I20260808 23:38:52.950620 18046 leader_election.cc:302] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29159da4a3d149079c3e29364eb25a7c; no voters:
I20260808 23:38:52.951363 18046 leader_election.cc:288] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:52.951498 18057 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:52.952620 18057 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [term 1 LEADER]: Becoming Leader. State: Replica: 29159da4a3d149079c3e29364eb25a7c, State: Running, Role: LEADER
I20260808 23:38:52.953293 18057 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29159da4a3d149079c3e29364eb25a7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46479 } }
I20260808 23:38:52.954103 18046 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:52.956626 18059 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29159da4a3d149079c3e29364eb25a7c. Latest consensus state: current_term: 1 leader_uuid: "29159da4a3d149079c3e29364eb25a7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29159da4a3d149079c3e29364eb25a7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46479 } } }
I20260808 23:38:52.957193 18059 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:52.969854 18058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29159da4a3d149079c3e29364eb25a7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29159da4a3d149079c3e29364eb25a7c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46479 } } }
I20260808 23:38:52.972213 18050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:52.948684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:37503 (local address 127.0.0.1:46479)
0808 23:38:52.948921 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:52.948928 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:52.949511 (+ 583us) server_negotiation.cc:407] Connection header received
0808 23:38:52.949675 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:52.949684 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:52.949782 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:52.949911 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:52.951800 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:52.953133 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:52.954718 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:52.955512 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:52.955674 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:52.960179 (+ 4505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:52.960188 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:52.960196 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:52.960280 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:52.965551 (+ 5271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:52.967247 (+ 1696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:52.967256 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:52.967262 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:52.967512 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:52.968344 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:52.968351 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:52.968357 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:52.968969 (+ 612us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:52.971635 (+ 2666us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:52.971789 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 23:38:52.971955 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 23:38:52.972313 18058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:52.974145 18062 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:52.981844 18062 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:52.991956 18062 catalog_manager.cc:1347] Generated new cluster ID: 184d1b86c1ff4c7f89ded7418fee1a68
I20260808 23:38:52.992096 18062 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:53.008339 18062 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:53.010015 18062 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:53.018798 18062 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29159da4a3d149079c3e29364eb25a7c: Generated new TSK 0
I20260808 23:38:53.020040 18062 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:38:53.034096 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 17974
I20260808 23:38:53.035836 18041 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:53.132221 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 17974
W20260808 23:38:53.155117 17959 connection.cc:535] client connection to 127.0.0.1:46479 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46479): Connection reset by peer (error 104)
2026-08-08T23:38:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2312 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:53 dist-test-slave-1x4g krb5kdc[18081](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:53 dist-test-slave-1x4g krb5kdc[18081](info): set up 2 sockets
Aug 08 23:38:53 dist-test-slave-1x4g krb5kdc[18081](info): commencing operation
krb5kdc: starting...
W20260808 23:38:54.329478 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.000s sys 0.056s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:38:54 dist-test-slave-1x4g krb5kdc[18081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:38:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 23:38:54.728683 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41323
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41323
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:55.103628 18094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:55.104019 18094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:55.104207 18094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:55.113713 18094 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:55.113950 18094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:55.114068 18094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:55.114182 18094 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:55.114269 18094 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:55.126490 18094 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41323
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:55.127969 18094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:55.129505 18094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:55.142765 18099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:55.142721 18103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:55.143364 18100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:55.143710 18094 server_base.cc:1034] running on GCE node
I20260808 23:38:55.144737 18094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:55.146507 18094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:55.147780 18094 hybrid_clock.cc:648] HybridClock initialized: now 1786232335147712 us; error 68 us; skew 500 ppm
I20260808 23:38:55.148192 18094 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:55 dist-test-slave-1x4g krb5kdc[18081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232335, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:55.151683 18094 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 23:38:55.153506 18094 webserver.cc:460] Webserver started at http://127.0.0.1:41809/ using document root <none> and password file <none>
I20260808 23:38:55.154309 18094 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:55.154484 18094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:55.154827 18094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:55.158274 18094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "ba8c50fa690f44c5a53cdcb889c353e3"
format_stamp: "Formatted at 2026-08-08 23:38:55 on dist-test-slave-1x4g"
server_key: "2f9c2c27427b05104dd5701005e01713"
server_key_iv: "df42f7809912b4e85e072ec563ef1dd2"
server_key_version: "encryptionkey@0"
I20260808 23:38:55.159179 18094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "ba8c50fa690f44c5a53cdcb889c353e3"
format_stamp: "Formatted at 2026-08-08 23:38:55 on dist-test-slave-1x4g"
server_key: "2f9c2c27427b05104dd5701005e01713"
server_key_iv: "df42f7809912b4e85e072ec563ef1dd2"
server_key_version: "encryptionkey@0"
I20260808 23:38:55.165307 18094 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 23:38:55.169498 18110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:55.171165 18094 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:38:55.171422 18094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "ba8c50fa690f44c5a53cdcb889c353e3"
format_stamp: "Formatted at 2026-08-08 23:38:55 on dist-test-slave-1x4g"
server_key: "2f9c2c27427b05104dd5701005e01713"
server_key_iv: "df42f7809912b4e85e072ec563ef1dd2"
server_key_version: "encryptionkey@0"
I20260808 23:38:55.171682 18094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:55.191710 18094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:55.196502 18094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:55.196938 18094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:55.218343 18094 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41323
I20260808 23:38:55.218364 18163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41323 every 8 connection(s)
I20260808 23:38:55.219983 18094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:55.221179 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 18094
I20260808 23:38:55.221383 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:55.221804 27455 external_mini_cluster.cc:1428] Setting key 05b6060d68512f3a67ff5a3a2fca3d39
I20260808 23:38:55.225170 18164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:55.239342 18168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:55.223891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:49953 (local address 127.0.0.1:41323)
0808 23:38:55.224811 (+ 920us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:55.224827 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:55.224884 (+ 57us) server_negotiation.cc:407] Connection header received
0808 23:38:55.227347 (+ 2463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:55.227381 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:55.227989 (+ 608us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:55.228501 (+ 512us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:55.229382 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:55.231576 (+ 2194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:55.233240 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:55.234375 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:55.234597 (+ 222us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:55.236035 (+ 1438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:55.236047 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:55.236069 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:55.236995 (+ 926us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:55.237114 (+ 119us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:55.237153 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:55.237346 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:55.237637 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 23:38:55.237858 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":357,"threads_started":1}
I20260808 23:38:55.240991 18164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3: Bootstrap starting.
I20260808 23:38:55.244105 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:38:55.245018 18164 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:55.246160 18164 log.cc:824] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:55.249981 18164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3: No bootstrap required, opened a new log
I20260808 23:38:55.255620 18168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:55.248839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:44179 (local address 127.0.0.1:41323)
0808 23:38:55.249028 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:55.249054 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:55.249519 (+ 465us) server_negotiation.cc:407] Connection header received
0808 23:38:55.249757 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:55.249761 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:55.249829 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:55.249936 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:55.250541 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:55.251319 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:55.252699 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:55.253283 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:55.253432 (+ 149us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:55.254767 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:55.254773 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:55.254776 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:55.254800 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:55.254849 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:55.254866 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:55.255007 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:55.255243 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 23:38:55.255311 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 23:38:55.258867 18164 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8c50fa690f44c5a53cdcb889c353e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41323 } }
I20260808 23:38:55.259326 18164 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:55.259439 18164 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba8c50fa690f44c5a53cdcb889c353e3, State: Initialized, Role: FOLLOWER
I20260808 23:38:55.260157 18164 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8c50fa690f44c5a53cdcb889c353e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41323 } }
I20260808 23:38:55.260432 18164 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:55.260604 18164 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:55.260864 18164 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:55.263190 18164 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8c50fa690f44c5a53cdcb889c353e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41323 } }
I20260808 23:38:55.263751 18164 leader_election.cc:302] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba8c50fa690f44c5a53cdcb889c353e3; no voters:
I20260808 23:38:55.264387 18164 leader_election.cc:288] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:55.264551 18176 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:55.265316 18176 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [term 1 LEADER]: Becoming Leader. State: Replica: ba8c50fa690f44c5a53cdcb889c353e3, State: Running, Role: LEADER
I20260808 23:38:55.265859 18176 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8c50fa690f44c5a53cdcb889c353e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41323 } }
I20260808 23:38:55.266741 18164 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:55.269013 18177 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba8c50fa690f44c5a53cdcb889c353e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8c50fa690f44c5a53cdcb889c353e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41323 } } }
I20260808 23:38:55.269469 18177 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:55.269337 18178 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba8c50fa690f44c5a53cdcb889c353e3. Latest consensus state: current_term: 1 leader_uuid: "ba8c50fa690f44c5a53cdcb889c353e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba8c50fa690f44c5a53cdcb889c353e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41323 } } }
I20260808 23:38:55.269760 18178 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:55.272908 18181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:55.279093 18181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:55.289981 18181 catalog_manager.cc:1347] Generated new cluster ID: fc6a13db64e342d1983e6dcf479e3667
I20260808 23:38:55.290133 18181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:55.310820 18181 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:55.312886 18181 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:55.323518 18181 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba8c50fa690f44c5a53cdcb889c353e3: Generated new TSK 0
I20260808 23:38:55.324689 18181 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:38:55.338601 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 18094
W20260808 23:38:55.339965 18159 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.163:49953
W20260808 23:38:55.340924 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 18094: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:38:55.341092 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 18094
W20260808 23:38:55.363832 18079 connection.cc:535] client connection to 127.0.0.1:41323 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41323): Connection reset by peer (error 104)
2026-08-08T23:38:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2208 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:55 dist-test-slave-1x4g krb5kdc[18198](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:55 dist-test-slave-1x4g krb5kdc[18198](info): set up 2 sockets
Aug 08 23:38:55 dist-test-slave-1x4g krb5kdc[18198](info): commencing operation
krb5kdc: starting...
W20260808 23:38:56.547230 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:38:56 dist-test-slave-1x4g krb5kdc[18198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232336, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:38:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 23:38:56.925726 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42897
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:57.300340 18211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:57.300773 18211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:57.300988 18211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:57.309064 18211 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:57.309252 18211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:57.309372 18211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:57.309479 18211 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:57.309571 18211 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:57.320573 18211 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42897
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:57.322183 18211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:57.324191 18211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:57.337843 18217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:57.337932 18216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:57.337910 18219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:57.339156 18211 server_base.cc:1034] running on GCE node
I20260808 23:38:57.340188 18211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:57.342059 18211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:57.343338 18211 hybrid_clock.cc:648] HybridClock initialized: now 1786232337343252 us; error 86 us; skew 500 ppm
I20260808 23:38:57.343775 18211 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:57 dist-test-slave-1x4g krb5kdc[18198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232337, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:57.352052 18211 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 23:38:57.354085 18211 webserver.cc:460] Webserver started at http://127.0.0.1:44677/ using document root <none> and password file <none>
I20260808 23:38:57.354915 18211 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:57.355086 18211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:57.355441 18211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:57.358943 18211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "67cfcfe8569246c3afbe954c021afd77"
format_stamp: "Formatted at 2026-08-08 23:38:57 on dist-test-slave-1x4g"
server_key: "5493425d3577696a3189d89e9d99e8e7"
server_key_iv: "e7400604bb94b18249da47ebf5052260"
server_key_version: "encryptionkey@0"
I20260808 23:38:57.359905 18211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "67cfcfe8569246c3afbe954c021afd77"
format_stamp: "Formatted at 2026-08-08 23:38:57 on dist-test-slave-1x4g"
server_key: "5493425d3577696a3189d89e9d99e8e7"
server_key_iv: "e7400604bb94b18249da47ebf5052260"
server_key_version: "encryptionkey@0"
I20260808 23:38:57.366197 18211 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 23:38:57.370697 18226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:57.372457 18211 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 23:38:57.372746 18211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "67cfcfe8569246c3afbe954c021afd77"
format_stamp: "Formatted at 2026-08-08 23:38:57 on dist-test-slave-1x4g"
server_key: "5493425d3577696a3189d89e9d99e8e7"
server_key_iv: "e7400604bb94b18249da47ebf5052260"
server_key_version: "encryptionkey@0"
I20260808 23:38:57.373047 18211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:57.379899 18211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:57.385265 18211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:57.385643 18211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:57.407007 18211 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42897
I20260808 23:38:57.407063 18281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42897 every 8 connection(s)
I20260808 23:38:57.408624 18211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:57.413203 18282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:38:57.414321 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 18211
I20260808 23:38:57.414534 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:57.415134 27455 external_mini_cluster.cc:1428] Setting key 7eb968771f5d43401ba3f2b4b7b3c2cd
I20260808 23:38:57.424467 18285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:57.417285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:51211 (local address 127.0.0.1:42897)
0808 23:38:57.418242 (+ 957us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:57.418255 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:57.418307 (+ 52us) server_negotiation.cc:407] Connection header received
0808 23:38:57.420411 (+ 2104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:57.420448 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:57.420988 (+ 540us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:57.421424 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:57.422718 (+ 1294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:57.422725 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:57.422739 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:57.422757 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:57.422829 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:57.422851 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:57.423059 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:57.423177 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 23:38:57.423423 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":668,"thread_start_us":433,"threads_started":1}
I20260808 23:38:57.428529 18282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77: Bootstrap starting.
I20260808 23:38:57.428867 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:38:57.432328 18282 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:57.433799 18282 log.cc:824] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:57.436733 18285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:57.433636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:41935 (local address 127.0.0.1:42897)
0808 23:38:57.433863 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:57.433869 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:57.434413 (+ 544us) server_negotiation.cc:407] Connection header received
0808 23:38:57.434668 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:57.434672 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:57.434727 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:57.434834 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:57.435959 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:57.435964 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:57.435968 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:38:57.435987 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:57.436051 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:38:57.436074 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:57.436200 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:57.436335 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 23:38:57.436409 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 23:38:57.437722 18282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77: No bootstrap required, opened a new log
I20260808 23:38:57.446138 18282 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67cfcfe8569246c3afbe954c021afd77" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42897 } }
I20260808 23:38:57.446688 18282 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:57.446805 18282 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67cfcfe8569246c3afbe954c021afd77, State: Initialized, Role: FOLLOWER
I20260808 23:38:57.447492 18282 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67cfcfe8569246c3afbe954c021afd77" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42897 } }
I20260808 23:38:57.447770 18282 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:57.447942 18282 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:57.448124 18282 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:57.450698 18282 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67cfcfe8569246c3afbe954c021afd77" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42897 } }
I20260808 23:38:57.451375 18282 leader_election.cc:302] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67cfcfe8569246c3afbe954c021afd77; no voters:
I20260808 23:38:57.452085 18282 leader_election.cc:288] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:57.452286 18292 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:57.453114 18292 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [term 1 LEADER]: Becoming Leader. State: Replica: 67cfcfe8569246c3afbe954c021afd77, State: Running, Role: LEADER
I20260808 23:38:57.453797 18292 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67cfcfe8569246c3afbe954c021afd77" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42897 } }
I20260808 23:38:57.454676 18282 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:57.457346 18293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67cfcfe8569246c3afbe954c021afd77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67cfcfe8569246c3afbe954c021afd77" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42897 } } }
I20260808 23:38:57.457358 18294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67cfcfe8569246c3afbe954c021afd77. Latest consensus state: current_term: 1 leader_uuid: "67cfcfe8569246c3afbe954c021afd77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67cfcfe8569246c3afbe954c021afd77" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42897 } } }
I20260808 23:38:57.457926 18293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:57.457995 18294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77 [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:57.460681 18298 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:57.466831 18298 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:57.478188 18298 catalog_manager.cc:1347] Generated new cluster ID: 19bf7e6522cf4d69968b665189216d5b
I20260808 23:38:57.478391 18298 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:57.490609 18298 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:57.491122 18298 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:57.501466 18298 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67cfcfe8569246c3afbe954c021afd77: Generated new TSK 0
I20260808 23:38:57.502771 18298 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:38:57.517586 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 18211
W20260808 23:38:57.519291 18277 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.163:51211
W20260808 23:38:57.520145 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 18211: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:38:57.520309 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 18211
2026-08-08T23:38:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2178 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:57 dist-test-slave-1x4g krb5kdc[18313](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:57 dist-test-slave-1x4g krb5kdc[18313](info): set up 2 sockets
Aug 08 23:38:57 dist-test-slave-1x4g krb5kdc[18313](info): commencing operation
krb5kdc: starting...
W20260808 23:38:58.718259 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.002s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:38:58 dist-test-slave-1x4g krb5kdc[18313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:38:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:38:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:38:59.108814 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:44427
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:37145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:44427
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:38:59.485031 18327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:38:59.485466 18327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:38:59.485646 18327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:38:59.493453 18327 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:38:59.493600 18327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:38:59.493654 18327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:38:59.493718 18327 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:38:59.493763 18327 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:38:59.504374 18327 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:37145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:44427
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:44427
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:38:59.505889 18327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:38:59.507326 18327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:38:59.521582 18333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:59.521555 18332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:38:59.521641 18335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:38:59.523351 18327 server_base.cc:1034] running on GCE node
I20260808 23:38:59.524346 18327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:38:59.526189 18327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:38:59.527459 18327 hybrid_clock.cc:648] HybridClock initialized: now 1786232339527418 us; error 57 us; skew 500 ppm
I20260808 23:38:59.527870 18327 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:38:59 dist-test-slave-1x4g krb5kdc[18313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232339, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:38:59.531502 18327 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:38:59.533357 18327 webserver.cc:460] Webserver started at http://127.26.207.254:37921/ using document root <none> and password file <none>
I20260808 23:38:59.534166 18327 fs_manager.cc:359] Metadata directory not provided
I20260808 23:38:59.534329 18327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:38:59.534693 18327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:38:59.538221 18327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "461fb0e41ac04663a0f5dd3b1a59866e"
format_stamp: "Formatted at 2026-08-08 23:38:59 on dist-test-slave-1x4g"
server_key: "51eb55a9705ed7bf10d1942989e292d1"
server_key_iv: "e4f129569aea4aea58bea301318c2ebf"
server_key_version: "encryptionkey@0"
I20260808 23:38:59.539148 18327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "461fb0e41ac04663a0f5dd3b1a59866e"
format_stamp: "Formatted at 2026-08-08 23:38:59 on dist-test-slave-1x4g"
server_key: "51eb55a9705ed7bf10d1942989e292d1"
server_key_iv: "e4f129569aea4aea58bea301318c2ebf"
server_key_version: "encryptionkey@0"
I20260808 23:38:59.545307 18327 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 23:38:59.549353 18342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:38:59.550976 18327 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:38:59.551220 18327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "461fb0e41ac04663a0f5dd3b1a59866e"
format_stamp: "Formatted at 2026-08-08 23:38:59 on dist-test-slave-1x4g"
server_key: "51eb55a9705ed7bf10d1942989e292d1"
server_key_iv: "e4f129569aea4aea58bea301318c2ebf"
server_key_version: "encryptionkey@0"
I20260808 23:38:59.551465 18327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:38:59.575881 18327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:38:59.581068 18327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:38:59.581424 18327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:38:59.603242 18327 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:44427
I20260808 23:38:59.603261 18396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:44427 every 8 connection(s)
I20260808 23:38:59.604816 18327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:38:59.606704 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 18327
I20260808 23:38:59.606901 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:38:59.607475 27455 external_mini_cluster.cc:1428] Setting key 7bc17f835a74fd953afbbe03a3c8b8fb
I20260808 23:38:59.610097 18397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 23:38:59 dist-test-slave-1x4g krb5kdc[18313](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:38:59.625255 18397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e: Bootstrap starting.
I20260808 23:38:59.628916 18397 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e: Neither blocks nor log segments found. Creating new log.
I20260808 23:38:59.630089 18397 log.cc:824] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e: Log is configured to *not* fsync() on all Append() calls
I20260808 23:38:59.633731 18397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e: No bootstrap required, opened a new log
I20260808 23:38:59.633926 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:59.609492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44981 (local address 127.26.207.254:44427)
0808 23:38:59.610411 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:59.610428 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:59.610492 (+ 64us) server_negotiation.cc:407] Connection header received
0808 23:38:59.612270 (+ 1778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:59.612294 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:59.612726 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:59.613195 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:59.615221 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:59.616675 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:59.618599 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:59.619374 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:59.619542 (+ 168us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:59.625184 (+ 5642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:59.625194 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:59.625212 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:59.625267 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:59.628632 (+ 3365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:59.629725 (+ 1093us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:59.629733 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:59.629741 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:59.629935 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:59.630514 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:59.630517 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:59.630520 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:59.631461 (+ 941us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:59.631769 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:59.632364 (+ 595us) server_negotiation.cc:299] Negotiation successful
0808 23:38:59.632765 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":396,"threads_started":1}
I20260808 23:38:59.638530 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:38:59.642863 18397 raft_consensus.cc:348] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "461fb0e41ac04663a0f5dd3b1a59866e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44427 } }
I20260808 23:38:59.643440 18397 raft_consensus.cc:374] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:38:59.643577 18397 raft_consensus.cc:729] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 461fb0e41ac04663a0f5dd3b1a59866e, State: Initialized, Role: FOLLOWER
I20260808 23:38:59.644407 18397 consensus_queue.cc:260] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "461fb0e41ac04663a0f5dd3b1a59866e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44427 } }
I20260808 23:38:59.644734 18397 raft_consensus.cc:388] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:38:59.644939 18397 raft_consensus.cc:482] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:38:59.645164 18397 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:38:59.648468 18397 raft_consensus.cc:504] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "461fb0e41ac04663a0f5dd3b1a59866e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44427 } }
I20260808 23:38:59.649260 18397 leader_election.cc:302] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 461fb0e41ac04663a0f5dd3b1a59866e; no voters:
I20260808 23:38:59.650063 18397 leader_election.cc:288] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:38:59.650225 18407 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:38:59.652621 18397 sys_catalog.cc:564] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:38:59.655241 18407 raft_consensus.cc:686] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [term 1 LEADER]: Becoming Leader. State: Replica: 461fb0e41ac04663a0f5dd3b1a59866e, State: Running, Role: LEADER
I20260808 23:38:59.656208 18407 consensus_queue.cc:237] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "461fb0e41ac04663a0f5dd3b1a59866e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44427 } }
I20260808 23:38:59.662135 18409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 461fb0e41ac04663a0f5dd3b1a59866e. Latest consensus state: current_term: 1 leader_uuid: "461fb0e41ac04663a0f5dd3b1a59866e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "461fb0e41ac04663a0f5dd3b1a59866e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44427 } } }
I20260808 23:38:59.662634 18409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:59.663345 18408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "461fb0e41ac04663a0f5dd3b1a59866e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "461fb0e41ac04663a0f5dd3b1a59866e" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44427 } } }
I20260808 23:38:59.663655 18408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e [sys.catalog]: This master's current role is: LEADER
I20260808 23:38:59.665872 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:38:59.643404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41199 (local address 127.26.207.254:44427)
0808 23:38:59.643645 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 23:38:59.643653 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:38:59.644289 (+ 636us) server_negotiation.cc:407] Connection header received
0808 23:38:59.644523 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:38:59.644527 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:38:59.644597 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:38:59.644730 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:38:59.647004 (+ 2274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:59.647837 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:59.649860 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:38:59.650676 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:38:59.650874 (+ 198us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:38:59.655029 (+ 4155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:38:59.655039 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:38:59.655047 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:38:59.655139 (+ 92us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:38:59.660127 (+ 4988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:59.661723 (+ 1596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:59.661731 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:59.661736 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:59.662010 (+ 274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:38:59.662776 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:38:59.662787 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:38:59.662790 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:38:59.663263 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:38:59.663624 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0808 23:38:59.664974 (+ 1350us) server_negotiation.cc:299] Negotiation successful
0808 23:38:59.665246 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 23:38:59.670214 18418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:38:59.675308 18418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:38:59.686312 18418 catalog_manager.cc:1347] Generated new cluster ID: 1c3f22653d97425e8dd806d02bd9efee
I20260808 23:38:59.686666 18418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:38:59.706468 18418 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:38:59.707895 18418 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:38:59.714932 18418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 461fb0e41ac04663a0f5dd3b1a59866e: Generated new TSK 0
I20260808 23:38:59.715924 18418 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:38:59.727725 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 18327
I20260808 23:38:59.729205 18392 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:38:59.825601 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 18327
W20260808 23:38:59.848417 18311 connection.cc:535] client connection to 127.26.207.254:44427 recv error: Network error: failed to read from TLS socket (remote: 127.26.207.254:44427): Connection reset by peer (error 104)
2026-08-08T23:38:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2307 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:38:59 dist-test-slave-1x4g krb5kdc[18430](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:38:59 dist-test-slave-1x4g krb5kdc[18430](info): set up 2 sockets
Aug 08 23:38:59 dist-test-slave-1x4g krb5kdc[18430](info): commencing operation
krb5kdc: starting...
W20260808 23:39:01.030229 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.001s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:39:01 dist-test-slave-1x4g krb5kdc[18430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:39:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:39:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:39:01.409312 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:44801
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:43359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:44801
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:39:01.790340 18443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:39:01.790716 18443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:39:01.790819 18443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:39:01.798610 18443 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:39:01.798761 18443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:39:01.798812 18443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:39:01.798874 18443 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:39:01.798921 18443 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:39:01.809829 18443 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:43359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:44801
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:44801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:39:01.811291 18443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:39:01.812747 18443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:39:01.827095 18448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:01.827059 18452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:01.827018 18450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:39:01.827976 18443 server_base.cc:1034] running on GCE node
I20260808 23:39:01.829026 18443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:39:01.830796 18443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:39:01.832126 18443 hybrid_clock.cc:648] HybridClock initialized: now 1786232341832075 us; error 48 us; skew 500 ppm
I20260808 23:39:01.832653 18443 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:39:01 dist-test-slave-1x4g krb5kdc[18430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232341, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:39:01.836647 18443 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:39:01.838586 18443 webserver.cc:460] Webserver started at http://127.26.207.254:35583/ using document root <none> and password file <none>
I20260808 23:39:01.839404 18443 fs_manager.cc:359] Metadata directory not provided
I20260808 23:39:01.839577 18443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:39:01.839926 18443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:39:01.843475 18443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "93b3f5a371b944d1b0db35c66504fbda"
format_stamp: "Formatted at 2026-08-08 23:39:01 on dist-test-slave-1x4g"
server_key: "27a2941f683bca543899acd894dbb797"
server_key_iv: "5aecb42e1a1e5836f4a5edf0752ef0f7"
server_key_version: "encryptionkey@0"
I20260808 23:39:01.844485 18443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "93b3f5a371b944d1b0db35c66504fbda"
format_stamp: "Formatted at 2026-08-08 23:39:01 on dist-test-slave-1x4g"
server_key: "27a2941f683bca543899acd894dbb797"
server_key_iv: "5aecb42e1a1e5836f4a5edf0752ef0f7"
server_key_version: "encryptionkey@0"
I20260808 23:39:01.851373 18443 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 23:39:01.855669 18459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:39:01.857421 18443 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 23:39:01.857671 18443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "93b3f5a371b944d1b0db35c66504fbda"
format_stamp: "Formatted at 2026-08-08 23:39:01 on dist-test-slave-1x4g"
server_key: "27a2941f683bca543899acd894dbb797"
server_key_iv: "5aecb42e1a1e5836f4a5edf0752ef0f7"
server_key_version: "encryptionkey@0"
I20260808 23:39:01.857911 18443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:39:01.877163 18443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:39:01.882045 18443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:39:01.882372 18443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:39:01.903340 18443 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:44801
I20260808 23:39:01.903375 18515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:44801 every 8 connection(s)
I20260808 23:39:01.904994 18443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:39:01.907930 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 18443
I20260808 23:39:01.908159 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:39:01.908635 27455 external_mini_cluster.cc:1428] Setting key 0d88be354211e07e12b386f2bef19dbd
I20260808 23:39:01.909612 18516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:39:01.923267 18519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:01.910594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39609 (local address 127.26.207.254:44801)
0808 23:39:01.911569 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:01.911582 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:01.911630 (+ 48us) server_negotiation.cc:407] Connection header received
0808 23:39:01.913399 (+ 1769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:01.913433 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:01.913922 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:01.914414 (+ 492us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:01.915016 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:01.916485 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:01.918135 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:01.918895 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:01.919114 (+ 219us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:01.920614 (+ 1500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:01.920623 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:01.920642 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:39:01.921382 (+ 740us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:01.921474 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:39:01.921504 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:01.921683 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:01.922009 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 23:39:01.922204 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":406,"threads_started":1}
I20260808 23:39:01.923540 18516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda: Bootstrap starting.
I20260808 23:39:01.927289 18516 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda: Neither blocks nor log segments found. Creating new log.
I20260808 23:39:01.927547 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:39:01.928503 18516 log.cc:824] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda: Log is configured to *not* fsync() on all Append() calls
I20260808 23:39:01.931658 18516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda: No bootstrap required, opened a new log
I20260808 23:39:01.941072 18519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:01.932417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56479 (local address 127.26.207.254:44801)
0808 23:39:01.932627 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:01.932635 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:01.933129 (+ 494us) server_negotiation.cc:407] Connection header received
0808 23:39:01.933298 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:01.933304 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:01.933386 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:01.933516 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:01.934087 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:01.935383 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:01.937021 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:01.937816 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:01.937998 (+ 182us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:01.939930 (+ 1932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:01.939939 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:01.939944 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:39:01.939981 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:01.940044 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:39:01.940070 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:01.940204 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:01.940567 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 23:39:01.940649 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 23:39:01.942426 18516 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93b3f5a371b944d1b0db35c66504fbda" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44801 } }
I20260808 23:39:01.942947 18516 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:39:01.943080 18516 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b3f5a371b944d1b0db35c66504fbda, State: Initialized, Role: FOLLOWER
I20260808 23:39:01.943845 18516 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93b3f5a371b944d1b0db35c66504fbda" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44801 } }
I20260808 23:39:01.944130 18516 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:39:01.944290 18516 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:39:01.944497 18516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:39:01.946983 18516 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93b3f5a371b944d1b0db35c66504fbda" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44801 } }
I20260808 23:39:01.947607 18516 leader_election.cc:302] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93b3f5a371b944d1b0db35c66504fbda; no voters:
I20260808 23:39:01.948377 18516 leader_election.cc:288] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:39:01.948621 18526 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:39:01.950201 18526 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [term 1 LEADER]: Becoming Leader. State: Replica: 93b3f5a371b944d1b0db35c66504fbda, State: Running, Role: LEADER
I20260808 23:39:01.951174 18516 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:39:01.951392 18526 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93b3f5a371b944d1b0db35c66504fbda" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44801 } }
I20260808 23:39:01.954638 18528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93b3f5a371b944d1b0db35c66504fbda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93b3f5a371b944d1b0db35c66504fbda" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44801 } } }
I20260808 23:39:01.955139 18528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [sys.catalog]: This master's current role is: LEADER
I20260808 23:39:01.955751 18529 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93b3f5a371b944d1b0db35c66504fbda. Latest consensus state: current_term: 1 leader_uuid: "93b3f5a371b944d1b0db35c66504fbda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93b3f5a371b944d1b0db35c66504fbda" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44801 } } }
I20260808 23:39:01.956138 18529 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda [sys.catalog]: This master's current role is: LEADER
I20260808 23:39:01.958897 18536 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:39:01.965175 18536 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:39:01.976898 18536 catalog_manager.cc:1347] Generated new cluster ID: 8b088b9571944b4d8a73436059518803
I20260808 23:39:01.977069 18536 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:39:01.992097 18536 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:39:01.993595 18536 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:39:02.006731 18536 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93b3f5a371b944d1b0db35c66504fbda: Generated new TSK 0
I20260808 23:39:02.007933 18536 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:39:02.026229 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 18443
W20260808 23:39:02.027720 18511 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39609
W20260808 23:39:02.028630 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 18443: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:39:02.028851 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 18443
W20260808 23:39:02.052230 18428 connection.cc:535] client connection to 127.26.207.254:44801 recv error: Network error: failed to read from TLS socket (remote: 127.26.207.254:44801): Connection reset by peer (error 104)
2026-08-08T23:39:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2203 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:39:02 dist-test-slave-1x4g krb5kdc[18548](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:39:02 dist-test-slave-1x4g krb5kdc[18548](info): set up 2 sockets
Aug 08 23:39:02 dist-test-slave-1x4g krb5kdc[18548](info): commencing operation
krb5kdc: starting...
W20260808 23:39:03.260238 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.187s user 0.000s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:39:03 dist-test-slave-1x4g krb5kdc[18548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232343, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:39:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:39:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:39:03.642673 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:36911
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:42285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:36911
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:39:04.026765 18562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:39:04.027164 18562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:39:04.027326 18562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:39:04.035084 18562 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:39:04.035262 18562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:39:04.035372 18562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:39:04.035480 18562 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:39:04.035557 18562 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:39:04.045996 18562 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:42285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:36911
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:36911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:39:04.047489 18562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:39:04.048995 18562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:39:04.061846 18567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:04.061926 18568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:04.061901 18570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:39:04.062477 18562 server_base.cc:1034] running on GCE node
I20260808 23:39:04.063366 18562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:39:04.064986 18562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:39:04.066236 18562 hybrid_clock.cc:648] HybridClock initialized: now 1786232344066196 us; error 40 us; skew 500 ppm
I20260808 23:39:04.066630 18562 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:39:04 dist-test-slave-1x4g krb5kdc[18548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232344, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:39:04.075171 18562 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:39:04.077102 18562 webserver.cc:460] Webserver started at http://127.26.207.254:46767/ using document root <none> and password file <none>
I20260808 23:39:04.077906 18562 fs_manager.cc:359] Metadata directory not provided
I20260808 23:39:04.078073 18562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:39:04.078426 18562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:39:04.081923 18562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "841af86e66784d519419d935819388f4"
format_stamp: "Formatted at 2026-08-08 23:39:04 on dist-test-slave-1x4g"
server_key: "c35ce7bd493656a08a48fcd4e75d52bc"
server_key_iv: "feed31bc530e7ddecd8645174a5fac33"
server_key_version: "encryptionkey@0"
I20260808 23:39:04.082844 18562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "841af86e66784d519419d935819388f4"
format_stamp: "Formatted at 2026-08-08 23:39:04 on dist-test-slave-1x4g"
server_key: "c35ce7bd493656a08a48fcd4e75d52bc"
server_key_iv: "feed31bc530e7ddecd8645174a5fac33"
server_key_version: "encryptionkey@0"
I20260808 23:39:04.088922 18562 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.002s
I20260808 23:39:04.093014 18577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:39:04.094586 18562 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 23:39:04.094820 18562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "841af86e66784d519419d935819388f4"
format_stamp: "Formatted at 2026-08-08 23:39:04 on dist-test-slave-1x4g"
server_key: "c35ce7bd493656a08a48fcd4e75d52bc"
server_key_iv: "feed31bc530e7ddecd8645174a5fac33"
server_key_version: "encryptionkey@0"
I20260808 23:39:04.095063 18562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:39:04.101825 18562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:39:04.106703 18562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:39:04.107056 18562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:39:04.127625 18562 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:36911
I20260808 23:39:04.127657 18631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:36911 every 8 connection(s)
I20260808 23:39:04.129359 18562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:39:04.131832 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 18562
I20260808 23:39:04.132033 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:39:04.132596 27455 external_mini_cluster.cc:1428] Setting key e976cd97631c7c8aa062d6fecd777896
I20260808 23:39:04.134037 18632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:39:04.142174 18636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:04.134521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41835 (local address 127.26.207.254:36911)
0808 23:39:04.135381 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:04.135399 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:04.135460 (+ 61us) server_negotiation.cc:407] Connection header received
0808 23:39:04.137682 (+ 2222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:04.137716 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:04.138252 (+ 536us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:04.138801 (+ 549us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:04.139879 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:04.139888 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:04.139922 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:39:04.139947 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:04.140040 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:39:04.140079 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:04.140340 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:04.140484 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 23:39:04.140708 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":342,"threads_started":1}
I20260808 23:39:04.146286 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:39:04.149948 18632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4: Bootstrap starting.
I20260808 23:39:04.154384 18632 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4: Neither blocks nor log segments found. Creating new log.
I20260808 23:39:04.154588 18636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:04.151814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60571 (local address 127.26.207.254:36911)
0808 23:39:04.152065 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:04.152074 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:04.152527 (+ 453us) server_negotiation.cc:407] Connection header received
0808 23:39:04.152694 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:04.152699 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:04.152764 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:04.152916 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:04.153850 (+ 934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:04.153856 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:04.153860 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:39:04.153882 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:04.153947 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:39:04.153970 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:04.154098 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:04.154164 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 23:39:04.154229 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 23:39:04.155831 18632 log.cc:824] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4: Log is configured to *not* fsync() on all Append() calls
I20260808 23:39:04.158932 18632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4: No bootstrap required, opened a new log
I20260808 23:39:04.166690 18632 raft_consensus.cc:348] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841af86e66784d519419d935819388f4" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36911 } }
I20260808 23:39:04.167135 18632 raft_consensus.cc:374] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:39:04.167266 18632 raft_consensus.cc:729] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841af86e66784d519419d935819388f4, State: Initialized, Role: FOLLOWER
I20260808 23:39:04.167901 18632 consensus_queue.cc:260] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841af86e66784d519419d935819388f4" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36911 } }
I20260808 23:39:04.168176 18632 raft_consensus.cc:388] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:39:04.168341 18632 raft_consensus.cc:482] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:39:04.168565 18632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:39:04.170938 18632 raft_consensus.cc:504] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841af86e66784d519419d935819388f4" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36911 } }
I20260808 23:39:04.171445 18632 leader_election.cc:302] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 841af86e66784d519419d935819388f4; no voters:
I20260808 23:39:04.172034 18632 leader_election.cc:288] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:39:04.172224 18643 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:39:04.172987 18643 raft_consensus.cc:686] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [term 1 LEADER]: Becoming Leader. State: Replica: 841af86e66784d519419d935819388f4, State: Running, Role: LEADER
I20260808 23:39:04.173527 18643 consensus_queue.cc:237] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841af86e66784d519419d935819388f4" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36911 } }
I20260808 23:39:04.174650 18632 sys_catalog.cc:564] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:39:04.177136 18644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "841af86e66784d519419d935819388f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841af86e66784d519419d935819388f4" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36911 } } }
I20260808 23:39:04.177001 18646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 841af86e66784d519419d935819388f4. Latest consensus state: current_term: 1 leader_uuid: "841af86e66784d519419d935819388f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "841af86e66784d519419d935819388f4" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 36911 } } }
I20260808 23:39:04.177670 18644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [sys.catalog]: This master's current role is: LEADER
I20260808 23:39:04.177706 18646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4 [sys.catalog]: This master's current role is: LEADER
I20260808 23:39:04.182782 18652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:39:04.187340 18652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:39:04.197003 18652 catalog_manager.cc:1347] Generated new cluster ID: 7e659134bcf74ad886ec1eabb3f796dd
I20260808 23:39:04.197156 18652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:39:04.220542 18652 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:39:04.221171 18652 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:39:04.232074 18652 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 841af86e66784d519419d935819388f4: Generated new TSK 0
I20260808 23:39:04.233471 18652 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:39:04.245910 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 18562
W20260808 23:39:04.247203 18627 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:41835
W20260808 23:39:04.248064 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 18562: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:39:04.248234 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 18562
2026-08-08T23:39:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2217 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:39:04 dist-test-slave-1x4g krb5kdc[18667](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:39:04 dist-test-slave-1x4g krb5kdc[18667](info): set up 2 sockets
Aug 08 23:39:04 dist-test-slave-1x4g krb5kdc[18667](info): commencing operation
krb5kdc: starting...
W20260808 23:39:05.457515 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.003s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:39:05 dist-test-slave-1x4g krb5kdc[18667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:39:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:39:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:39:05.849643 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:44487
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:34961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:44487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:39:06.229471 18681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:39:06.229885 18681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:39:06.230070 18681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:39:06.237836 18681 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:39:06.238049 18681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:39:06.238165 18681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:39:06.238278 18681 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:39:06.238369 18681 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:39:06.248908 18681 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:34961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:44487
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:44487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:39:06.250447 18681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:39:06.251976 18681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:39:06.265723 18689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:06.265928 18686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:06.265923 18687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:39:06.267192 18681 server_base.cc:1034] running on GCE node
I20260808 23:39:06.268180 18681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:39:06.269964 18681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:39:06.271207 18681 hybrid_clock.cc:648] HybridClock initialized: now 1786232346271152 us; error 50 us; skew 500 ppm
I20260808 23:39:06.271628 18681 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:39:06 dist-test-slave-1x4g krb5kdc[18667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232346, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:39:06.275223 18681 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:39:06.277099 18681 webserver.cc:460] Webserver started at http://127.26.207.254:34445/ using document root <none> and password file <none>
I20260808 23:39:06.277884 18681 fs_manager.cc:359] Metadata directory not provided
I20260808 23:39:06.278048 18681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:39:06.278401 18681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:39:06.281973 18681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "716c97c7c97b436187ff8676708ec4da"
format_stamp: "Formatted at 2026-08-08 23:39:06 on dist-test-slave-1x4g"
server_key: "f403ba2df32b4aa247c8f71921b01a2d"
server_key_iv: "b5b9220b18e0398dbe6991b2ade410e3"
server_key_version: "encryptionkey@0"
I20260808 23:39:06.282924 18681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "716c97c7c97b436187ff8676708ec4da"
format_stamp: "Formatted at 2026-08-08 23:39:06 on dist-test-slave-1x4g"
server_key: "f403ba2df32b4aa247c8f71921b01a2d"
server_key_iv: "b5b9220b18e0398dbe6991b2ade410e3"
server_key_version: "encryptionkey@0"
I20260808 23:39:06.289006 18681 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 23:39:06.293303 18696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:39:06.295058 18681 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 23:39:06.295306 18681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "716c97c7c97b436187ff8676708ec4da"
format_stamp: "Formatted at 2026-08-08 23:39:06 on dist-test-slave-1x4g"
server_key: "f403ba2df32b4aa247c8f71921b01a2d"
server_key_iv: "b5b9220b18e0398dbe6991b2ade410e3"
server_key_version: "encryptionkey@0"
I20260808 23:39:06.295557 18681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:39:06.318073 18681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:39:06.323014 18681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:39:06.323369 18681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:39:06.345589 18750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:44487 every 8 connection(s)
I20260808 23:39:06.345583 18681 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:44487
I20260808 23:39:06.347237 18681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:39:06.350097 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 18681
I20260808 23:39:06.350319 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:39:06.350808 27455 external_mini_cluster.cc:1428] Setting key de299007d90160886de2dd330b9a3007
I20260808 23:39:06.351791 18751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 23:39:06 dist-test-slave-1x4g krb5kdc[18667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:39:06.366854 18751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da: Bootstrap starting.
I20260808 23:39:06.371349 18751 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da: Neither blocks nor log segments found. Creating new log.
I20260808 23:39:06.372740 18751 log.cc:824] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da: Log is configured to *not* fsync() on all Append() calls
I20260808 23:39:06.376523 18751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da: No bootstrap required, opened a new log
I20260808 23:39:06.376924 18754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:06.352931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46891 (local address 127.26.207.254:44487)
0808 23:39:06.353809 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:06.353822 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:06.353869 (+ 47us) server_negotiation.cc:407] Connection header received
0808 23:39:06.355616 (+ 1747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:06.355642 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:06.356217 (+ 575us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:06.356720 (+ 503us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:06.358440 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:06.359898 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:06.361410 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:06.362160 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:06.362401 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:06.367744 (+ 5343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:06.367754 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:06.367773 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:06.367829 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:06.371999 (+ 4170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:06.373042 (+ 1043us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:06.373050 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:06.373064 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:06.373273 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:06.373753 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:06.373757 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:06.373759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:06.374383 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:06.374727 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:06.375241 (+ 514us) server_negotiation.cc:299] Negotiation successful
0808 23:39:06.375727 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":371,"threads_started":1}
I20260808 23:39:06.381424 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:39:06.386641 18751 raft_consensus.cc:348] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "716c97c7c97b436187ff8676708ec4da" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44487 } }
I20260808 23:39:06.387264 18751 raft_consensus.cc:374] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:39:06.387406 18751 raft_consensus.cc:729] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 716c97c7c97b436187ff8676708ec4da, State: Initialized, Role: FOLLOWER
I20260808 23:39:06.388165 18751 consensus_queue.cc:260] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "716c97c7c97b436187ff8676708ec4da" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44487 } }
I20260808 23:39:06.388466 18751 raft_consensus.cc:388] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:39:06.388633 18751 raft_consensus.cc:482] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:39:06.388875 18751 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:39:06.391549 18751 raft_consensus.cc:504] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "716c97c7c97b436187ff8676708ec4da" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44487 } }
I20260808 23:39:06.392211 18751 leader_election.cc:302] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 716c97c7c97b436187ff8676708ec4da; no voters:
I20260808 23:39:06.393033 18751 leader_election.cc:288] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:39:06.393153 18761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:39:06.396107 18751 sys_catalog.cc:564] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:39:06.397099 18761 raft_consensus.cc:686] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [term 1 LEADER]: Becoming Leader. State: Replica: 716c97c7c97b436187ff8676708ec4da, State: Running, Role: LEADER
I20260808 23:39:06.397970 18761 consensus_queue.cc:237] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "716c97c7c97b436187ff8676708ec4da" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44487 } }
I20260808 23:39:06.401854 18763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 716c97c7c97b436187ff8676708ec4da. Latest consensus state: current_term: 1 leader_uuid: "716c97c7c97b436187ff8676708ec4da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "716c97c7c97b436187ff8676708ec4da" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44487 } } }
I20260808 23:39:06.402298 18763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [sys.catalog]: This master's current role is: LEADER
I20260808 23:39:06.403224 18762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "716c97c7c97b436187ff8676708ec4da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "716c97c7c97b436187ff8676708ec4da" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 44487 } } }
I20260808 23:39:06.403800 18762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da [sys.catalog]: This master's current role is: LEADER
I20260808 23:39:06.404219 18754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:06.386455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37483 (local address 127.26.207.254:44487)
0808 23:39:06.386738 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:06.386745 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:06.387156 (+ 411us) server_negotiation.cc:407] Connection header received
0808 23:39:06.387405 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:06.387414 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:06.387500 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:06.387631 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:06.389475 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:06.390320 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:06.391690 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:06.392279 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:06.392462 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:06.395452 (+ 2990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:06.395458 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:06.395468 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:06.395507 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:06.399250 (+ 3743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:06.400130 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:06.400136 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:06.400140 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:06.400348 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:06.400965 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:06.400972 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:06.400976 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:06.401473 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:06.403232 (+ 1759us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:06.403537 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 23:39:06.403830 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 23:39:06.405823 18768 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:39:06.413632 18768 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:39:06.424474 18768 catalog_manager.cc:1347] Generated new cluster ID: ac1f119a503844d0b6feb7adc9dac2ac
I20260808 23:39:06.424614 18768 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:39:06.443678 18768 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:39:06.445183 18768 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:39:06.457852 18768 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 716c97c7c97b436187ff8676708ec4da: Generated new TSK 0
I20260808 23:39:06.459236 18768 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:39:06.475196 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 18681
I20260808 23:39:06.477243 18745 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:39:06.576681 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 18681
2026-08-08T23:39:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2325 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:39:06 dist-test-slave-1x4g krb5kdc[18784](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:39:06 dist-test-slave-1x4g krb5kdc[18784](info): set up 2 sockets
Aug 08 23:39:06 dist-test-slave-1x4g krb5kdc[18784](info): commencing operation
krb5kdc: starting...
W20260808 23:39:07.779181 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.004s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:39:08 dist-test-slave-1x4g krb5kdc[18784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:39:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:39:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:39:08.165565 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:32819
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:34435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:32819
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:39:08.545596 18797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:39:08.545950 18797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:39:08.546176 18797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:39:08.554055 18797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:39:08.554237 18797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:39:08.554356 18797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:39:08.554463 18797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:39:08.554531 18797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:39:08.566331 18797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:34435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:32819
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:32819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:39:08.567780 18797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:39:08.569299 18797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:39:08.582604 18802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:08.582629 18805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:08.582856 18803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:39:08.586711 18797 server_base.cc:1034] running on GCE node
I20260808 23:39:08.587741 18797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:39:08.589650 18797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:39:08.590894 18797 hybrid_clock.cc:648] HybridClock initialized: now 1786232348590851 us; error 41 us; skew 500 ppm
I20260808 23:39:08.591320 18797 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:39:08 dist-test-slave-1x4g krb5kdc[18784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232348, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:39:08.594859 18797 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:39:08.596725 18797 webserver.cc:460] Webserver started at http://127.26.207.254:43655/ using document root <none> and password file <none>
I20260808 23:39:08.597621 18797 fs_manager.cc:359] Metadata directory not provided
I20260808 23:39:08.597786 18797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:39:08.598136 18797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:39:08.601707 18797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "8b84dbfece914e12ae050b3ce43e0d21"
format_stamp: "Formatted at 2026-08-08 23:39:08 on dist-test-slave-1x4g"
server_key: "b2f4f097f478d96943f55872439f3ff7"
server_key_iv: "5c1790999c68adddbe2a752d78fa802c"
server_key_version: "encryptionkey@0"
I20260808 23:39:08.602689 18797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "8b84dbfece914e12ae050b3ce43e0d21"
format_stamp: "Formatted at 2026-08-08 23:39:08 on dist-test-slave-1x4g"
server_key: "b2f4f097f478d96943f55872439f3ff7"
server_key_iv: "5c1790999c68adddbe2a752d78fa802c"
server_key_version: "encryptionkey@0"
I20260808 23:39:08.608747 18797 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260808 23:39:08.612908 18812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:39:08.614634 18797 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 23:39:08.614892 18797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "8b84dbfece914e12ae050b3ce43e0d21"
format_stamp: "Formatted at 2026-08-08 23:39:08 on dist-test-slave-1x4g"
server_key: "b2f4f097f478d96943f55872439f3ff7"
server_key_iv: "5c1790999c68adddbe2a752d78fa802c"
server_key_version: "encryptionkey@0"
I20260808 23:39:08.615162 18797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:39:08.636498 18797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:39:08.641366 18797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:39:08.641716 18797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:39:08.663678 18797 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:32819
I20260808 23:39:08.663703 18864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:32819 every 8 connection(s)
I20260808 23:39:08.665364 18797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:39:08.669883 18865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:39:08.674966 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 18797
I20260808 23:39:08.675207 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:39:08.675834 27455 external_mini_cluster.cc:1428] Setting key 98dedabdde52f34369df725869b515dd
I20260808 23:39:08.687001 18865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21: Bootstrap starting.
I20260808 23:39:08.691854 18865 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21: Neither blocks nor log segments found. Creating new log.
I20260808 23:39:08.693403 18865 log.cc:824] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21: Log is configured to *not* fsync() on all Append() calls
I20260808 23:39:08.693821 18868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:08.678083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36535 (local address 127.26.207.254:32819)
0808 23:39:08.679020 (+ 937us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:08.679038 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:08.679099 (+ 61us) server_negotiation.cc:407] Connection header received
0808 23:39:08.681450 (+ 2351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:08.681492 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:08.682214 (+ 722us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:08.682785 (+ 571us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:08.683472 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:08.685894 (+ 2422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:08.687770 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:08.688924 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:08.689181 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:08.690516 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:08.690537 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:08.690557 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:39:08.691353 (+ 796us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:08.691470 (+ 117us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:39:08.691507 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:08.691645 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:08.691970 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 23:39:08.692302 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":405,"threads_started":1}
I20260808 23:39:08.697032 18865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21: No bootstrap required, opened a new log
I20260808 23:39:08.698352 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:39:08.706308 18865 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b84dbfece914e12ae050b3ce43e0d21" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 32819 } }
I20260808 23:39:08.706791 18865 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:39:08.706931 18865 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b84dbfece914e12ae050b3ce43e0d21, State: Initialized, Role: FOLLOWER
I20260808 23:39:08.707754 18865 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b84dbfece914e12ae050b3ce43e0d21" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 32819 } }
I20260808 23:39:08.708102 18865 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:39:08.708271 18865 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:39:08.708475 18865 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:39:08.710271 18868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:08.703111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43567 (local address 127.26.207.254:32819)
0808 23:39:08.703316 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:08.703323 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:08.703837 (+ 514us) server_negotiation.cc:407] Connection header received
0808 23:39:08.704086 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:08.704091 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:08.704172 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:08.704305 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:08.704894 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:08.705656 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:08.707178 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:08.707877 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:08.708028 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:08.709431 (+ 1403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:08.709439 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:08.709444 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:39:08.709468 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:08.709533 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:39:08.709562 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:08.709672 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:08.709802 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 23:39:08.709912 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 23:39:08.712050 18865 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b84dbfece914e12ae050b3ce43e0d21" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 32819 } }
I20260808 23:39:08.712591 18865 leader_election.cc:302] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b84dbfece914e12ae050b3ce43e0d21; no voters:
I20260808 23:39:08.713266 18865 leader_election.cc:288] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:39:08.713450 18875 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:39:08.714279 18875 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [term 1 LEADER]: Becoming Leader. State: Replica: 8b84dbfece914e12ae050b3ce43e0d21, State: Running, Role: LEADER
I20260808 23:39:08.714903 18875 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b84dbfece914e12ae050b3ce43e0d21" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 32819 } }
I20260808 23:39:08.715659 18865 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:39:08.719203 18877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b84dbfece914e12ae050b3ce43e0d21. Latest consensus state: current_term: 1 leader_uuid: "8b84dbfece914e12ae050b3ce43e0d21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b84dbfece914e12ae050b3ce43e0d21" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 32819 } } }
I20260808 23:39:08.719267 18876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b84dbfece914e12ae050b3ce43e0d21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b84dbfece914e12ae050b3ce43e0d21" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 32819 } } }
I20260808 23:39:08.719743 18877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [sys.catalog]: This master's current role is: LEADER
I20260808 23:39:08.719753 18876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21 [sys.catalog]: This master's current role is: LEADER
I20260808 23:39:08.723369 18882 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:39:08.729477 18882 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:39:08.740700 18882 catalog_manager.cc:1347] Generated new cluster ID: 54ca6b836ede4ee19128037a9f926254
I20260808 23:39:08.740900 18882 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:39:08.755228 18882 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:39:08.757378 18882 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:39:08.770979 18882 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b84dbfece914e12ae050b3ce43e0d21: Generated new TSK 0
I20260808 23:39:08.772297 18882 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:39:08.786293 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 18797
W20260808 23:39:08.787703 18860 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:36535
W20260808 23:39:08.788568 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 18797: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:39:08.788745 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 18797
2026-08-08T23:39:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2216 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:39:08 dist-test-slave-1x4g krb5kdc[18896](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:39:08 dist-test-slave-1x4g krb5kdc[18896](info): set up 2 sockets
Aug 08 23:39:08 dist-test-slave-1x4g krb5kdc[18896](info): commencing operation
krb5kdc: starting...
W20260808 23:39:09.997282 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.005s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:39:10 dist-test-slave-1x4g krb5kdc[18896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232350, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:39:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:39:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:39:10.385697 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:45671
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:38981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:45671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:39:10.764276 18910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:39:10.764619 18910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:39:10.764834 18910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:39:10.772553 18910 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:39:10.772694 18910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:39:10.772790 18910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:39:10.772933 18910 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:39:10.772998 18910 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:39:10.783644 18910 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:38981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:45671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:45671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:39:10.785259 18910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:39:10.786706 18910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:39:10.799849 18918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:10.799858 18920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:10.799908 18916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:39:10.801095 18910 server_base.cc:1034] running on GCE node
I20260808 23:39:10.801960 18910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:39:10.803622 18910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:39:10.804924 18910 hybrid_clock.cc:648] HybridClock initialized: now 1786232350804863 us; error 48 us; skew 500 ppm
I20260808 23:39:10.805307 18910 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:39:10 dist-test-slave-1x4g krb5kdc[18896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232350, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:39:10.814630 18910 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:39:10.816435 18910 webserver.cc:460] Webserver started at http://127.26.207.254:36255/ using document root <none> and password file <none>
I20260808 23:39:10.817325 18910 fs_manager.cc:359] Metadata directory not provided
I20260808 23:39:10.817448 18910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:39:10.817725 18910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:39:10.821339 18910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "2396c5df4dda44519f64e77575b76577"
format_stamp: "Formatted at 2026-08-08 23:39:10 on dist-test-slave-1x4g"
server_key: "070e2eb9c4f829b4b5fb6269998345e0"
server_key_iv: "d24523d08b0275bd9f30ad7e086a2956"
server_key_version: "encryptionkey@0"
I20260808 23:39:10.822362 18910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "2396c5df4dda44519f64e77575b76577"
format_stamp: "Formatted at 2026-08-08 23:39:10 on dist-test-slave-1x4g"
server_key: "070e2eb9c4f829b4b5fb6269998345e0"
server_key_iv: "d24523d08b0275bd9f30ad7e086a2956"
server_key_version: "encryptionkey@0"
I20260808 23:39:10.829488 18910 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.004s
I20260808 23:39:10.836218 18927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:39:10.838356 18910 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 23:39:10.838613 18910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "2396c5df4dda44519f64e77575b76577"
format_stamp: "Formatted at 2026-08-08 23:39:10 on dist-test-slave-1x4g"
server_key: "070e2eb9c4f829b4b5fb6269998345e0"
server_key_iv: "d24523d08b0275bd9f30ad7e086a2956"
server_key_version: "encryptionkey@0"
I20260808 23:39:10.838851 18910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:39:10.845732 18910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:39:10.850699 18910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:39:10.851100 18910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:39:10.873131 18910 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:45671
I20260808 23:39:10.873175 18980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:45671 every 8 connection(s)
I20260808 23:39:10.874771 18910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:39:10.879130 18981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:39:10.884001 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 18910
I20260808 23:39:10.884166 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:39:10.884706 27455 external_mini_cluster.cc:1428] Setting key 2d240493eed2039e9fd14843b3a96fca
I20260808 23:39:10.892402 18981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577: Bootstrap starting.
I20260808 23:39:10.894474 18984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:10.886727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38935 (local address 127.26.207.254:45671)
0808 23:39:10.887593 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:10.887607 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:10.887657 (+ 50us) server_negotiation.cc:407] Connection header received
0808 23:39:10.890278 (+ 2621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:10.890310 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:10.890868 (+ 558us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:10.891354 (+ 486us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:10.892645 (+ 1291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:10.892652 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:10.892666 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:39:10.892684 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:10.892753 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:39:10.892846 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:10.893131 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:10.893274 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 23:39:10.893481 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":627,"thread_start_us":364,"threads_started":1}
I20260808 23:39:10.896488 18981 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577: Neither blocks nor log segments found. Creating new log.
I20260808 23:39:10.897936 18981 log.cc:824] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577: Log is configured to *not* fsync() on all Append() calls
I20260808 23:39:10.899149 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:39:10.901973 18981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577: No bootstrap required, opened a new log
I20260808 23:39:10.908295 18984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:10.905053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35897 (local address 127.26.207.254:45671)
0808 23:39:10.905312 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:10.905322 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:10.905865 (+ 543us) server_negotiation.cc:407] Connection header received
0808 23:39:10.906148 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:10.906152 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:10.906228 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:10.906349 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:10.907485 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:10.907489 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:10.907493 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 23:39:10.907512 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:10.907562 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 23:39:10.907579 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:10.907699 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:10.907838 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 23:39:10.907893 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 23:39:10.912361 18981 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2396c5df4dda44519f64e77575b76577" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45671 } }
I20260808 23:39:10.912902 18981 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 23:39:10.913041 18981 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2396c5df4dda44519f64e77575b76577, State: Initialized, Role: FOLLOWER
I20260808 23:39:10.913710 18981 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2396c5df4dda44519f64e77575b76577" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45671 } }
I20260808 23:39:10.914009 18981 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 23:39:10.914176 18981 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 23:39:10.914369 18981 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:39:10.916940 18981 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2396c5df4dda44519f64e77575b76577" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45671 } }
I20260808 23:39:10.917557 18981 leader_election.cc:302] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2396c5df4dda44519f64e77575b76577; no voters:
I20260808 23:39:10.918426 18981 leader_election.cc:288] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 23:39:10.918548 18992 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:39:10.919411 18992 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [term 1 LEADER]: Becoming Leader. State: Replica: 2396c5df4dda44519f64e77575b76577, State: Running, Role: LEADER
I20260808 23:39:10.920050 18992 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2396c5df4dda44519f64e77575b76577" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45671 } }
I20260808 23:39:10.920943 18981 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:39:10.923863 18994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2396c5df4dda44519f64e77575b76577. Latest consensus state: current_term: 1 leader_uuid: "2396c5df4dda44519f64e77575b76577" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2396c5df4dda44519f64e77575b76577" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45671 } } }
I20260808 23:39:10.924419 18994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [sys.catalog]: This master's current role is: LEADER
I20260808 23:39:10.923825 18993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2396c5df4dda44519f64e77575b76577" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2396c5df4dda44519f64e77575b76577" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 45671 } } }
I20260808 23:39:10.925210 18993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577 [sys.catalog]: This master's current role is: LEADER
I20260808 23:39:10.930644 19000 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:39:10.936625 19000 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:39:10.948593 19000 catalog_manager.cc:1347] Generated new cluster ID: b70bd2c84d6f417c876bf9d704f1755c
I20260808 23:39:10.948764 19000 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:39:10.964910 19000 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:39:10.965423 19000 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:39:10.975795 19000 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2396c5df4dda44519f64e77575b76577: Generated new TSK 0
I20260808 23:39:10.976842 19000 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 23:39:10.994946 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 18910
W20260808 23:39:10.996351 18976 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:38935
W20260808 23:39:10.997251 27455 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 18910: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 23:39:10.997421 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 18910
2026-08-08T23:39:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2206 ms)
[----------] 18 tests from AuthTokenIssuingTest (40372 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:39:11 dist-test-slave-1x4g krb5kdc[19014](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:39:11 dist-test-slave-1x4g krb5kdc[19014](info): set up 2 sockets
Aug 08 23:39:11 dist-test-slave-1x4g krb5kdc[19014](info): commencing operation
krb5kdc: starting...
W20260808 23:39:12.225757 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.004s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:39:12 dist-test-slave-1x4g krb5kdc[19014](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:39:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:39:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:39:12.613945 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:35653
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:46461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:35653,127.26.207.253:38377,127.26.207.252:43963
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:39:12.999570 19027 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 23:39:12.999944 19027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:39:13.000013 19027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:39:13.000102 19027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:39:13.007783 19027 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:39:13.007915 19027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:39:13.007977 19027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:39:13.008024 19027 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:39:13.008083 19027 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:39:13.018868 19027 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:46461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:35653,127.26.207.253:38377,127.26.207.252:43963
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:35653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:39:13.020272 19027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:39:13.021790 19027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:39:13.035389 19032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:13.035334 19033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:13.035293 19036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:39:13.036178 19027 server_base.cc:1034] running on GCE node
I20260808 23:39:13.037215 19027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:39:13.038838 19027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:39:13.040077 19027 hybrid_clock.cc:648] HybridClock initialized: now 1786232353039991 us; error 58 us; skew 500 ppm
I20260808 23:39:13.040565 19027 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:39:13 dist-test-slave-1x4g krb5kdc[19014](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232353, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:39:13.044045 19027 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:39:13.045714 19027 webserver.cc:460] Webserver started at http://127.26.207.254:33757/ using document root <none> and password file <none>
I20260808 23:39:13.046518 19027 fs_manager.cc:359] Metadata directory not provided
I20260808 23:39:13.046617 19027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:39:13.046895 19027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:39:13.050073 19027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "036f8cda5d634fa9a7724661691c0cbb"
format_stamp: "Formatted at 2026-08-08 23:39:13 on dist-test-slave-1x4g"
server_key: "cb0f54b16a30f7d8ec51a1219fe30b05"
server_key_iv: "4a63eabe431d215f2aa1906bc6adf485"
server_key_version: "encryptionkey@0"
I20260808 23:39:13.050921 19027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "036f8cda5d634fa9a7724661691c0cbb"
format_stamp: "Formatted at 2026-08-08 23:39:13 on dist-test-slave-1x4g"
server_key: "cb0f54b16a30f7d8ec51a1219fe30b05"
server_key_iv: "4a63eabe431d215f2aa1906bc6adf485"
server_key_version: "encryptionkey@0"
I20260808 23:39:13.056949 19027 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260808 23:39:13.061024 19043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:39:13.062568 19027 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 23:39:13.062808 19027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "036f8cda5d634fa9a7724661691c0cbb"
format_stamp: "Formatted at 2026-08-08 23:39:13 on dist-test-slave-1x4g"
server_key: "cb0f54b16a30f7d8ec51a1219fe30b05"
server_key_iv: "4a63eabe431d215f2aa1906bc6adf485"
server_key_version: "encryptionkey@0"
I20260808 23:39:13.063074 19027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:39:13.089051 19027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:39:13.093724 19027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:39:13.093994 19027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:39:13.114554 19027 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:35653
I20260808 23:39:13.114573 19095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:35653 every 8 connection(s)
I20260808 23:39:13.116101 19027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:39:13.120394 19096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:39:13.124614 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 19027
I20260808 23:39:13.124905 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:39:13.125808 27455 external_mini_cluster.cc:1428] Setting key e1257e9b401addf2c67b8b0bb5c9212f
I20260808 23:39:13.129853 19096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:39:13 dist-test-slave-1x4g krb5kdc[19014](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232353, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:39:13.157979 19099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.134506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39658 (local address 127.26.207.254:35653)
0808 23:39:13.136875 (+ 2369us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:13.136883 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:13.136941 (+ 58us) server_negotiation.cc:407] Connection header received
0808 23:39:13.139435 (+ 2494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:13.139445 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:13.139793 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:13.140017 (+ 224us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:13.142020 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:13.143484 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:13.145073 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:13.145672 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:13.145893 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:13.149715 (+ 3822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:13.149724 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:13.149739 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:13.149788 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:13.152995 (+ 3207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:13.153830 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:13.153843 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:13.153845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:13.154003 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:13.154447 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:13.154452 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:13.154455 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:13.155051 (+ 596us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:13.155289 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:13.155857 (+ 568us) server_negotiation.cc:299] Negotiation successful
0808 23:39:13.156311 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":2096,"spinlock_wait_cycles":42880,"thread_start_us":1801,"threads_started":1}
I20260808 23:39:13.157999 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.134506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:35653 (local address 127.0.0.1:39658)
0808 23:39:13.135662 (+ 1156us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.135732 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:13.138871 (+ 3139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:13.140136 (+ 1265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:13.140147 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:13.141151 (+ 1004us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:13.141726 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:13.141761 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:13.143678 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:13.143684 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:13.144921 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:13.144935 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:13.145959 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:13.145966 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:13.146148 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:13.146944 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:13.146968 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:13.149435 (+ 2467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:13.153185 (+ 3750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:13.153199 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:13.153214 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:13.153662 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:13.154128 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:13.154135 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:13.154141 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:13.154315 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:13.155206 (+ 891us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:13.155214 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:13.155447 (+ 233us) client_negotiation.cc:769] Sending connection context
0808 23:39:13.155717 (+ 270us) client_negotiation.cc:240] Negotiation successful
0808 23:39:13.156450 (+ 733us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":804,"mutex_wait_us":207,"thread_start_us":522,"threads_started":1}
WARNING: no policy specified for kudu/127.26.207.253@KRBTEST.COM; defaulting to no policy
I20260808 23:39:13.161348 19096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } has no permanent_uuid. Determining permanent_uuid...
I20260808 23:39:13.162499 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.162081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38377 (local address 127.0.0.1:45344)
0808 23:39:13.162248 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.162368 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 23:39:13.162774 19044 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38377: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.253@KRBTEST.COM" created.
I20260808 23:39:13.164525 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.164090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38377 (local address 127.0.0.1:45352)
0808 23:39:13.164260 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.164362 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 23:39:13.164754 19096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.253:38377: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38377: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.253.keytab.
Entry for principal kudu/127.26.207.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.253.keytab.
I20260808 23:39:13.213150 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.253:38377
--webserver_interface=127.26.207.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.253.keytab
--principal=kudu/127.26.207.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:46461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:35653,127.26.207.253:38377,127.26.207.252:43963
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:39:13.214192 19096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } attempt: 1
I20260808 23:39:13.215693 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.215022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38377 (local address 127.0.0.1:45366)
0808 23:39:13.215291 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.215467 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260808 23:39:13.217078 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.216489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38377 (local address 127.0.0.1:45372)
0808 23:39:13.216716 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.216855 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260808 23:39:13.217316 19096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.253:38377: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38377: connect: Connection refused (error 111)
I20260808 23:39:13.285688 19096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } attempt: 2
I20260808 23:39:13.287344 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.286789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38377 (local address 127.0.0.1:45388)
0808 23:39:13.287092 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.287192 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260808 23:39:13.288539 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.288115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38377 (local address 127.0.0.1:45394)
0808 23:39:13.288281 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.288380 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 23:39:13.288753 19096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.253:38377: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38377: connect: Connection refused (error 111)
I20260808 23:39:13.380105 19096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } attempt: 3
I20260808 23:39:13.381445 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.380992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38377 (local address 127.0.0.1:45400)
0808 23:39:13.381196 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.381299 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 23:39:13.382758 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.382326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38377 (local address 127.0.0.1:45410)
0808 23:39:13.382493 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.382578 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 23:39:13.383124 19096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.253:38377: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38377: connect: Connection refused (error 111)
I20260808 23:39:13.526503 19096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } attempt: 4
I20260808 23:39:13.527980 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.527331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38377 (local address 127.0.0.1:45426)
0808 23:39:13.527716 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.527808 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212}
I20260808 23:39:13.529134 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.528691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38377 (local address 127.0.0.1:45442)
0808 23:39:13.528900 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.529003 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 23:39:13.529435 19096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.253:38377: Network error: Client connection negotiation failed: client connection to 127.26.207.253:38377: connect: Connection refused (error 111)
W20260808 23:39:13.598227 19103 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 23:39:13.598688 19103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:39:13.598829 19103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:39:13.598979 19103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:39:13.606798 19103 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:39:13.606968 19103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:39:13.607085 19103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:39:13.607185 19103 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:39:13.607280 19103 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:39:13.618883 19103 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:46461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:35653,127.26.207.253:38377,127.26.207.252:43963
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.253.keytab
--principal=kudu/127.26.207.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.253:38377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.207.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:39:13.620441 19103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:39:13.622012 19103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:39:13.635474 19108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:13.635429 19109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:13.635788 19112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:39:13.636480 19103 server_base.cc:1034] running on GCE node
I20260808 23:39:13.637473 19103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:39:13.639079 19103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:39:13.640394 19103 hybrid_clock.cc:648] HybridClock initialized: now 1786232353640318 us; error 45 us; skew 500 ppm
I20260808 23:39:13.640949 19103 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:39:13 dist-test-slave-1x4g krb5kdc[19014](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232353, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:39:13.645015 19103 init.cc:377] Logged in from keytab as kudu/127.26.207.253@KRBTEST.COM (short username kudu)
I20260808 23:39:13.646795 19103 webserver.cc:460] Webserver started at http://127.26.207.253:37367/ using document root <none> and password file <none>
I20260808 23:39:13.647822 19103 fs_manager.cc:359] Metadata directory not provided
I20260808 23:39:13.647993 19103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:39:13.648382 19103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:39:13.652019 19103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/data/instance:
uuid: "00bd514de80c401f9ccabf9a1aaf1494"
format_stamp: "Formatted at 2026-08-08 23:39:13 on dist-test-slave-1x4g"
server_key: "aaff1b9f9ddf802f3dc11a767694d933"
server_key_iv: "7ef9189537497211d3dffb262cb28a37"
server_key_version: "encryptionkey@0"
I20260808 23:39:13.653151 19103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/wal/instance:
uuid: "00bd514de80c401f9ccabf9a1aaf1494"
format_stamp: "Formatted at 2026-08-08 23:39:13 on dist-test-slave-1x4g"
server_key: "aaff1b9f9ddf802f3dc11a767694d933"
server_key_iv: "7ef9189537497211d3dffb262cb28a37"
server_key_version: "encryptionkey@0"
I20260808 23:39:13.659500 19103 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.002s
I20260808 23:39:13.664036 19119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:39:13.665778 19103 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 23:39:13.666040 19103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/wal
uuid: "00bd514de80c401f9ccabf9a1aaf1494"
format_stamp: "Formatted at 2026-08-08 23:39:13 on dist-test-slave-1x4g"
server_key: "aaff1b9f9ddf802f3dc11a767694d933"
server_key_iv: "7ef9189537497211d3dffb262cb28a37"
server_key_version: "encryptionkey@0"
I20260808 23:39:13.666340 19103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:39:13.685796 19103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:39:13.691305 19103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:39:13.691668 19103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:39:13.714167 19103 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.253:38377
I20260808 23:39:13.714205 19173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.253:38377 every 8 connection(s)
I20260808 23:39:13.715852 19103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/data/info.pb
I20260808 23:39:13.720476 19174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:39:13.723924 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 19103
I20260808 23:39:13.724159 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-1/wal/instance
I20260808 23:39:13.724750 27455 external_mini_cluster.cc:1428] Setting key 80d531b5b7f5aa0517eb305c5cbef319
I20260808 23:39:13.731325 19174 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:39:13 dist-test-slave-1x4g krb5kdc[19014](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232353, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.253@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:39:13.757894 19176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.735508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39668 (local address 127.26.207.254:35653)
0808 23:39:13.736218 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:13.736227 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:13.737369 (+ 1142us) server_negotiation.cc:407] Connection header received
0808 23:39:13.740185 (+ 2816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:13.740194 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:13.740307 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:13.740455 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:13.742708 (+ 2253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:13.743638 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:13.745608 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:13.746079 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:13.746245 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:13.750392 (+ 4147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:13.750398 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:13.750401 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:13.750450 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:13.753537 (+ 3087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:13.754764 (+ 1227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:13.754769 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:13.754772 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:13.754933 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:13.755500 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:13.755504 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:13.755507 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:13.755848 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:13.756030 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:13.757047 (+ 1017us) server_negotiation.cc:299] Negotiation successful
0808 23:39:13.757354 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":359,"threads_started":1}
I20260808 23:39:13.758687 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.736164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:35653 (local address 127.0.0.1:39668)
0808 23:39:13.737152 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.737207 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:13.739767 (+ 2560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:13.740752 (+ 985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:13.740767 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:13.741694 (+ 927us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:13.742378 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:13.742401 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:13.743865 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:13.743870 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:13.745385 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:13.745404 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:13.746378 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:13.746386 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:13.746657 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:13.747443 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:13.747470 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:13.750052 (+ 2582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:13.753763 (+ 3711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:13.753775 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:13.753797 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:13.754559 (+ 762us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:13.755089 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:13.755094 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:13.755098 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:13.755338 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:13.756004 (+ 666us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:13.756014 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:13.756451 (+ 437us) client_negotiation.cc:769] Sending connection context
0808 23:39:13.756844 (+ 393us) client_negotiation.cc:240] Negotiation successful
0808 23:39:13.757327 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":662,"thread_start_us":405,"threads_started":1}
I20260808 23:39:13.760815 19174 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.207.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.252@KRBTEST.COM" created.
Aug 08 23:39:13 dist-test-slave-1x4g krb5kdc[19014](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232353, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.253@KRBTEST.COM for kudu/127.26.207.253@KRBTEST.COM
I20260808 23:39:13.778716 19179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.761966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45448 (local address 127.26.207.253:38377)
0808 23:39:13.762662 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:13.762669 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:13.762695 (+ 26us) server_negotiation.cc:407] Connection header received
0808 23:39:13.762745 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:13.762751 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:13.762943 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:13.763088 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:13.764069 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:13.765580 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:13.766757 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:13.767585 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:13.767730 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:13.771762 (+ 4032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:13.771779 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:13.771803 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:13.771856 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:13.775087 (+ 3231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:13.776114 (+ 1027us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:13.776122 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:13.776124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:13.776270 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:13.776901 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:13.776905 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:13.776908 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:13.777346 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:13.777553 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:13.778022 (+ 469us) server_negotiation.cc:299] Negotiation successful
0808 23:39:13.778393 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":149,"server-negotiator.queue_time_us":540,"thread_start_us":386,"threads_started":1}
I20260808 23:39:13.778822 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.761637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38377 (local address 127.0.0.1:45448)
0808 23:39:13.761885 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.761904 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:13.762039 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:13.763156 (+ 1117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:13.763159 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:13.763580 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:13.763804 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:13.763820 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:13.765731 (+ 1911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:13.765739 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:13.766593 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:13.766606 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:13.767743 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:13.767748 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:13.767997 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:13.768700 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:13.768718 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:13.771475 (+ 2757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:13.775286 (+ 3811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:13.775295 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:13.775302 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:13.775947 (+ 645us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:13.776458 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:13.776465 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:13.776471 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:13.776672 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:13.777504 (+ 832us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:13.777512 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:13.777696 (+ 184us) client_negotiation.cc:769] Sending connection context
0808 23:39:13.777862 (+ 166us) client_negotiation.cc:240] Negotiation successful
0808 23:39:13.778250 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"mutex_wait_us":4}
I20260808 23:39:13.781823 19174 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } has no permanent_uuid. Determining permanent_uuid...
I20260808 23:39:13.783218 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.782566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33806)
0808 23:39:13.782812 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.782969 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260808 23:39:13.783550 19120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
I20260808 23:39:13.785508 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.784990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33812)
0808 23:39:13.785213 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.785329 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 23:39:13.785761 19174 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:43963: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.252.keytab.
Entry for principal kudu/127.26.207.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.252.keytab.
I20260808 23:39:13.808499 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.252:43963
--webserver_interface=127.26.207.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.252.keytab
--principal=kudu/127.26.207.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:46461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:35653,127.26.207.253:38377,127.26.207.252:43963
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:39:13.828723 19096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } attempt: 5
I20260808 23:39:13.835893 19174 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } attempt: 1
I20260808 23:39:13.838045 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.836835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33824)
0808 23:39:13.837683 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.837830 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":677}
I20260808 23:39:13.839699 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.839147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33840)
0808 23:39:13.839389 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.839516 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260808 23:39:13.840065 19174 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:43963: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Aug 08 23:39:13 dist-test-slave-1x4g krb5kdc[19014](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232353, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for kudu/127.26.207.253@KRBTEST.COM
I20260808 23:39:13.851650 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.829569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38377 (local address 127.0.0.1:45464)
0808 23:39:13.831085 (+ 1516us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.831109 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:13.831300 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:13.831879 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:13.831886 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:13.832571 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:13.832897 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:13.832912 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:13.834664 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:13.834671 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:13.836575 (+ 1904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:13.836599 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:13.837763 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:13.837769 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:13.838036 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:13.839625 (+ 1589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:13.839646 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:13.842240 (+ 2594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:13.847307 (+ 5067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:13.847313 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:13.847317 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:13.848206 (+ 889us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:13.848912 (+ 706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:13.848918 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:13.848922 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:13.849155 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:13.850196 (+ 1041us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:13.850205 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:13.850475 (+ 270us) client_negotiation.cc:769] Sending connection context
0808 23:39:13.850661 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 23:39:13.851130 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198}
I20260808 23:39:13.852921 19179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.829809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45464 (local address 127.26.207.253:38377)
0808 23:39:13.830282 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:13.830292 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:13.831244 (+ 952us) server_negotiation.cc:407] Connection header received
0808 23:39:13.831503 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:13.831511 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:13.831640 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:13.831765 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:13.833152 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:13.834477 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:13.837070 (+ 2593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:13.837594 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:13.837738 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:13.842576 (+ 4838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:13.842587 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:13.842594 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:13.842650 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:13.846950 (+ 4300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:13.848434 (+ 1484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:13.848443 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:13.848449 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:13.848677 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:13.849332 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:13.849342 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:13.849349 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:13.849857 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:13.850105 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:13.852140 (+ 2035us) server_negotiation.cc:299] Negotiation successful
0808 23:39:13.852482 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142}
I20260808 23:39:13.854485 19096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } has no permanent_uuid. Determining permanent_uuid...
I20260808 23:39:13.856009 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.855378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33852)
0808 23:39:13.855657 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.855788 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260808 23:39:13.857321 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.856934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33860)
0808 23:39:13.857097 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.857211 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 23:39:13.857637 19096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:43963: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
I20260808 23:39:13.908345 19174 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } attempt: 2
I20260808 23:39:13.908885 19096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } attempt: 1
I20260808 23:39:13.909803 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.909240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33874)
0808 23:39:13.909462 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.909574 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 23:39:13.910089 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.909561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33890)
0808 23:39:13.909778 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.909887 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 23:39:13.911134 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.910721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33898)
0808 23:39:13.910884 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.910975 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 23:39:13.911335 19174 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:43963: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
I20260808 23:39:13.911224 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.910856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33906)
0808 23:39:13.911005 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.911089 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 23:39:13.911748 19096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:43963: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
I20260808 23:39:13.979995 19096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } attempt: 2
I20260808 23:39:13.981462 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.980858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33910)
0808 23:39:13.981141 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.981240 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260808 23:39:13.982892 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:13.982426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33926)
0808 23:39:13.982632 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:13.982730 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 23:39:13.983189 19096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:43963: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
I20260808 23:39:14.002605 19174 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } attempt: 3
I20260808 23:39:14.003964 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.003466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33936)
0808 23:39:14.003680 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:14.003794 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260808 23:39:14.005493 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.004874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33950)
0808 23:39:14.005196 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:14.005312 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164}
W20260808 23:39:14.005872 19174 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:43963: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
I20260808 23:39:14.089454 19096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } attempt: 3
I20260808 23:39:14.090929 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.090264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33964)
0808 23:39:14.090552 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:14.090683 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260808 23:39:14.092315 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.091783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33976)
0808 23:39:14.092012 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:14.092123 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 23:39:14.092598 19096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:43963: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
I20260808 23:39:14.149148 19174 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } attempt: 4
I20260808 23:39:14.150555 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.149999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33978)
0808 23:39:14.150265 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:14.150368 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 23:39:14.151753 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.151355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33982)
0808 23:39:14.151550 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:14.151630 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260808 23:39:14.152071 19174 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:43963: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
W20260808 23:39:14.208863 19182 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 23:39:14.209327 19182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:39:14.209441 19182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:39:14.209570 19182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:39:14.217617 19182 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:39:14.217733 19182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:39:14.217792 19182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:39:14.217906 19182 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:39:14.218025 19182 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:39:14.228926 19182 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:46461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:35653,127.26.207.253:38377,127.26.207.252:43963
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.252.keytab
--principal=kudu/127.26.207.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.252:43963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.207.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:39:14.230755 19182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:39:14.232286 19182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:39:14.246388 19187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:14.246483 19190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:14.246456 19188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:39:14.247536 19182 server_base.cc:1034] running on GCE node
I20260808 23:39:14.248539 19182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:39:14.250291 19182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:39:14.251602 19182 hybrid_clock.cc:648] HybridClock initialized: now 1786232354251513 us; error 72 us; skew 500 ppm
I20260808 23:39:14.251998 19182 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:39:14 dist-test-slave-1x4g krb5kdc[19014](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232354, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:39:14.255872 19182 init.cc:377] Logged in from keytab as kudu/127.26.207.252@KRBTEST.COM (short username kudu)
I20260808 23:39:14.257745 19182 webserver.cc:460] Webserver started at http://127.26.207.252:37261/ using document root <none> and password file <none>
I20260808 23:39:14.258596 19182 fs_manager.cc:359] Metadata directory not provided
I20260808 23:39:14.258701 19182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:39:14.258996 19182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:39:14.262509 19182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/data/instance:
uuid: "2e2f633370304d6c8642e4034613c317"
format_stamp: "Formatted at 2026-08-08 23:39:14 on dist-test-slave-1x4g"
server_key: "1be710d94148dafdb3fdf79be731fb9f"
server_key_iv: "9910343c2a4a342cc851a9dcb1d5c14a"
server_key_version: "encryptionkey@0"
I20260808 23:39:14.263496 19182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/wal/instance:
uuid: "2e2f633370304d6c8642e4034613c317"
format_stamp: "Formatted at 2026-08-08 23:39:14 on dist-test-slave-1x4g"
server_key: "1be710d94148dafdb3fdf79be731fb9f"
server_key_iv: "9910343c2a4a342cc851a9dcb1d5c14a"
server_key_version: "encryptionkey@0"
I20260808 23:39:14.269873 19182 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260808 23:39:14.269825 19096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } attempt: 4
I20260808 23:39:14.271102 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.270633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:33998)
0808 23:39:14.270830 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:14.270942 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 23:39:14.272401 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.271992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:34010)
0808 23:39:14.272155 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:14.272237 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260808 23:39:14.272678 19096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:43963: Network error: Client connection negotiation failed: client connection to 127.26.207.252:43963: connect: Connection refused (error 111)
I20260808 23:39:14.274952 19198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:39:14.276906 19182 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 23:39:14.277108 19182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/wal
uuid: "2e2f633370304d6c8642e4034613c317"
format_stamp: "Formatted at 2026-08-08 23:39:14 on dist-test-slave-1x4g"
server_key: "1be710d94148dafdb3fdf79be731fb9f"
server_key_iv: "9910343c2a4a342cc851a9dcb1d5c14a"
server_key_version: "encryptionkey@0"
I20260808 23:39:14.277343 19182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:39:14.305747 19182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:39:14.310734 19182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:39:14.311021 19182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:39:14.331959 19182 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.252:43963
I20260808 23:39:14.331992 19250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.252:43963 every 8 connection(s)
I20260808 23:39:14.333642 19182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/data/info.pb
I20260808 23:39:14.334542 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 19182
I20260808 23:39:14.334776 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786231963826981-27455-0/minicluster-data/master-2/wal/instance
I20260808 23:39:14.335351 27455 external_mini_cluster.cc:1428] Setting key 31cd3af36b62f0d799d7ddb1cd1bd1b5
I20260808 23:39:14.338506 19251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:39:14.348071 19251 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:39:14 dist-test-slave-1x4g krb5kdc[19014](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.252@KRBTEST.COM
Aug 08 23:39:14 dist-test-slave-1x4g krb5kdc[19014](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232354, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.252@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:39:14.362236 19254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.337337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34012 (local address 127.26.207.252:43963)
0808 23:39:14.338224 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:14.338237 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:14.338281 (+ 44us) server_negotiation.cc:407] Connection header received
0808 23:39:14.340045 (+ 1764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:14.340070 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:14.340497 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:14.340965 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:14.342920 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.344374 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.346345 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.347155 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.347312 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:14.353319 (+ 6007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:14.353327 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:14.353342 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:14.353381 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:14.357374 (+ 3993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.358206 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.358213 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.358220 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.358400 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.358839 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.358849 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.358851 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.359417 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:14.359808 (+ 391us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:14.360317 (+ 509us) server_negotiation.cc:299] Negotiation successful
0808 23:39:14.360886 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":686,"thread_start_us":399,"threads_started":1}
I20260808 23:39:14.369314 19255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.351871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39672 (local address 127.26.207.254:35653)
0808 23:39:14.352454 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:14.352463 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:14.353025 (+ 562us) server_negotiation.cc:407] Connection header received
0808 23:39:14.353304 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:14.353309 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:14.353399 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:14.353496 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:14.355143 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.356345 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.358011 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.358424 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.358583 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:14.362277 (+ 3694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:14.362283 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:14.362286 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:14.362369 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:14.365821 (+ 3452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.366711 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.366717 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.366722 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.366906 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.367471 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.367478 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.367484 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.367885 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:14.368105 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:14.368671 (+ 566us) server_negotiation.cc:299] Negotiation successful
0808 23:39:14.368977 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":288,"threads_started":1}
I20260808 23:39:14.369314 19256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.351803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:35653 (local address 127.0.0.1:39672)
0808 23:39:14.352874 (+ 1071us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:14.352919 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:14.353130 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:14.353579 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:14.353592 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:14.354596 (+ 1004us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:14.354954 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:14.354968 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.356553 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.356557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:14.357821 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:14.357835 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.358632 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.358638 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:14.358825 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:14.359590 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:14.359608 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:14.362028 (+ 2420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:14.366012 (+ 3984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:14.366029 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:14.366034 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:14.366555 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:14.367146 (+ 591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:14.367152 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:14.367156 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:14.367320 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:14.368069 (+ 749us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:14.368076 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:14.368304 (+ 228us) client_negotiation.cc:769] Sending connection context
0808 23:39:14.368477 (+ 173us) client_negotiation.cc:240] Negotiation successful
0808 23:39:14.368819 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":777,"spinlock_wait_cycles":17664,"thread_start_us":633,"threads_started":1}
I20260808 23:39:14.371246 19251 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:39:14 dist-test-slave-1x4g krb5kdc[19014](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
Aug 08 23:39:14 dist-test-slave-1x4g krb5kdc[19014](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232354, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.252@KRBTEST.COM for kudu/127.26.207.253@KRBTEST.COM
I20260808 23:39:14.385457 19257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.365925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39686 (local address 127.26.207.254:35653)
0808 23:39:14.366778 (+ 853us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:14.366789 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:14.366816 (+ 27us) server_negotiation.cc:407] Connection header received
0808 23:39:14.366867 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:14.366872 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:14.366988 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:14.367091 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:14.368924 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.370265 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.371959 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.372686 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.372884 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:14.378546 (+ 5662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:14.378552 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:14.378556 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:14.378603 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:14.382190 (+ 3587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.383138 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.383145 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.383148 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.383326 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.383765 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.383770 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.383774 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.384088 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:14.384399 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:14.384731 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 23:39:14.385012 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":502,"threads_started":1}
I20260808 23:39:14.388698 19256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.372053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:38377 (local address 127.0.0.1:45476)
0808 23:39:14.372258 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:14.372281 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:14.372422 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:14.373125 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:14.373131 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:14.373677 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:14.373915 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:14.373929 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.375060 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.375076 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:14.376546 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:14.376564 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.377609 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.377619 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:14.377838 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:14.378522 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:14.378543 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:14.381379 (+ 2836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:14.385386 (+ 4007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:14.385393 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:14.385397 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:14.385990 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:14.386452 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:14.386458 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:14.386462 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:14.386680 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:14.387493 (+ 813us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:14.387497 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:14.387753 (+ 256us) client_negotiation.cc:769] Sending connection context
0808 23:39:14.387927 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 23:39:14.388298 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 23:39:14.388757 19259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.372162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45476 (local address 127.26.207.253:38377)
0808 23:39:14.372699 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:14.372705 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:14.372727 (+ 22us) server_negotiation.cc:407] Connection header received
0808 23:39:14.372830 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:14.372837 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:14.372934 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:14.373059 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:14.374149 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.374859 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.376819 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.377390 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.377514 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:14.381723 (+ 4209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:14.381729 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:14.381733 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:14.381775 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:14.385209 (+ 3434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.386144 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.386150 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.386153 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.386311 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.386811 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.386815 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.386817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.387251 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:14.387409 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:14.388048 (+ 639us) server_negotiation.cc:299] Negotiation successful
0808 23:39:14.388238 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":282,"threads_started":1}
I20260808 23:39:14.389936 19251 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:39:14 dist-test-slave-1x4g krb5kdc[19014](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.253@KRBTEST.COM
Aug 08 23:39:14 dist-test-slave-1x4g krb5kdc[19014](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232354, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.252@KRBTEST.COM for kudu/127.26.207.252@KRBTEST.COM
I20260808 23:39:14.405530 19254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.391052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34022 (local address 127.26.207.252:43963)
0808 23:39:14.391207 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:14.391211 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:14.391225 (+ 14us) server_negotiation.cc:407] Connection header received
0808 23:39:14.391266 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:14.391270 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:14.391323 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:14.391399 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:14.392136 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.393172 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.394736 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.395429 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.395595 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:14.399179 (+ 3584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:14.399183 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:14.399187 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:14.399221 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:14.402097 (+ 2876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.402946 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.402952 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.402956 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.403139 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.403657 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.403662 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.403666 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.404116 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:14.404234 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:14.404713 (+ 479us) server_negotiation.cc:299] Negotiation successful
0808 23:39:14.405067 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 23:39:14.405753 19260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.387332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45482 (local address 127.26.207.253:38377)
0808 23:39:14.388002 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:14.388008 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:14.388034 (+ 26us) server_negotiation.cc:407] Connection header received
0808 23:39:14.388092 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:14.388097 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:14.388175 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:14.388288 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:14.390073 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.391343 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.393023 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.393654 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.393788 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:14.399214 (+ 5426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:14.399220 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:14.399224 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:14.399263 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:14.402343 (+ 3080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.403337 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.403343 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.403346 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.403529 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.404014 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.404018 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.404020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.404369 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:14.404671 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:14.405017 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 23:39:14.405282 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":305,"threads_started":1}
I20260808 23:39:14.405776 19256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.390771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:34022)
0808 23:39:14.390971 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:14.390989 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:14.391101 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:14.391464 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:14.391472 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:14.391841 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:14.391985 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:14.391993 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.393302 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.393308 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:14.394584 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:14.394599 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.395648 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.395653 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:14.395830 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:14.396509 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:14.396528 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:14.398930 (+ 2402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:14.402287 (+ 3357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:14.402293 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:14.402297 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:14.402790 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:14.403318 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:14.403323 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:14.403326 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:14.403515 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:14.404248 (+ 733us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:14.404253 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:14.404438 (+ 185us) client_negotiation.cc:769] Sending connection context
0808 23:39:14.404597 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 23:39:14.405301 (+ 704us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":248}
I20260808 23:39:14.411172 19251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317: Bootstrap starting.
I20260808 23:39:14.411674 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:39:14.414944 19251 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317: Neither blocks nor log segments found. Creating new log.
I20260808 23:39:14.416451 19251 log.cc:824] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317: Log is configured to *not* fsync() on all Append() calls
I20260808 23:39:14.414772 19071 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "036f8cda5d634fa9a7724661691c0cbb"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39686
I20260808 23:39:14.420362 19251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317: No bootstrap required, opened a new log
I20260808 23:39:14.432065 19251 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } }
I20260808 23:39:14.432600 19251 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f633370304d6c8642e4034613c317, State: Initialized, Role: FOLLOWER
I20260808 23:39:14.433421 19251 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } }
I20260808 23:39:14.434808 19262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } } }
I20260808 23:39:14.435216 19262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:39:14.436503 19251 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 23:39:14.448108 19273 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 23:39:14.448279 19273 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 23:39:14.451342 19174 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } attempt: 5
I20260808 23:39:14.445922 19182 master_runner.cc:186] Error getting master registration for 127.26.207.254:35653: OK, instance_id { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" instance_seqno: 1786232353108729 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 23:39:14.456645 19182 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 08 23:39:14 dist-test-slave-1x4g krb5kdc[19014](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232353, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.253@KRBTEST.COM for kudu/127.26.207.252@KRBTEST.COM
I20260808 23:39:14.471141 19254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.452282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34036 (local address 127.26.207.252:43963)
0808 23:39:14.452527 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:14.452533 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:14.452558 (+ 25us) server_negotiation.cc:407] Connection header received
0808 23:39:14.452759 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:14.452786 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:14.452876 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:14.453019 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:14.454304 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.455436 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.457390 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.458132 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.458281 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:14.462579 (+ 4298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:14.462587 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:14.462592 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:14.462645 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:14.467160 (+ 4515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.468326 (+ 1166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.468332 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.468336 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.468535 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.469164 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.469170 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.469173 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.469709 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:14.469890 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:14.470446 (+ 556us) server_negotiation.cc:299] Negotiation successful
0808 23:39:14.470731 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 23:39:14.471166 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.452195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:34036)
0808 23:39:14.452394 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:14.452430 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:14.452568 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:14.453055 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:14.453060 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:14.453839 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:14.454119 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:14.454132 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.455605 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.455612 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:14.457183 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:14.457206 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.458327 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.458334 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:14.458631 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:14.459323 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:14.459348 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:14.462272 (+ 2924us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:14.467415 (+ 5143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:14.467422 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:14.467427 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:14.468130 (+ 703us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:14.468709 (+ 579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:14.468715 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:14.468719 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:14.469024 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:14.469876 (+ 852us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:14.469881 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:14.470092 (+ 211us) client_negotiation.cc:769] Sending connection context
0808 23:39:14.470264 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 23:39:14.470683 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 23:39:14.477625 19174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494: Bootstrap starting.
I20260808 23:39:14.481308 19174 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494: Neither blocks nor log segments found. Creating new log.
I20260808 23:39:14.482580 19174 log.cc:824] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494: Log is configured to *not* fsync() on all Append() calls
I20260808 23:39:14.485844 19174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494: No bootstrap required, opened a new log
I20260808 23:39:14.494406 19174 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } }
I20260808 23:39:14.494836 19174 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00bd514de80c401f9ccabf9a1aaf1494, State: Initialized, Role: FOLLOWER
I20260808 23:39:14.495352 19174 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } }
I20260808 23:39:14.496436 19276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } } }
I20260808 23:39:14.496932 19276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:39:14.497816 19174 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 23:39:14.512180 19289 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 23:39:14.512518 19289 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 23:39:14.506196 19103 master_runner.cc:186] Error getting master registration for 127.26.207.254:35653: OK, instance_id { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" instance_seqno: 1786232353108729 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 23:39:14.519531 19103 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 23:39:14.549927 19096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } attempt: 5
Aug 08 23:39:14 dist-test-slave-1x4g krb5kdc[19014](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232353, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for kudu/127.26.207.252@KRBTEST.COM
W20260808 23:39:14.563853 19204 tablet.cc:2369] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:39:14.569756 19254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.551308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34044 (local address 127.26.207.252:43963)
0808 23:39:14.551509 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:14.551516 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:14.551535 (+ 19us) server_negotiation.cc:407] Connection header received
0808 23:39:14.551605 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:14.551609 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:14.551679 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:14.551814 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:14.552901 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.553697 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.555656 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.556138 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.556292 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:14.561457 (+ 5165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:14.561465 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:14.561469 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:14.561514 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:14.565780 (+ 4266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.566808 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.566817 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.566822 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.567112 (+ 290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.567685 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.567698 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.567704 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.568172 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:14.568348 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:14.569031 (+ 683us) server_negotiation.cc:299] Negotiation successful
0808 23:39:14.569303 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 23:39:14.569787 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.550746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:43963 (local address 127.0.0.1:34044)
0808 23:39:14.550944 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:14.550970 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:14.551112 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:14.551872 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:14.551877 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:14.552472 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:14.552706 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:14.552719 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.553865 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.553873 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:14.555473 (+ 1600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:14.555490 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.556331 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.556339 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:14.556770 (+ 431us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:14.557649 (+ 879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:14.557684 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:14.561145 (+ 3461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:14.566033 (+ 4888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:14.566043 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:14.566047 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:14.566626 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:14.567256 (+ 630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:14.567262 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:14.567266 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:14.567478 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:14.568432 (+ 954us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:14.568441 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:14.568668 (+ 227us) client_negotiation.cc:769] Sending connection context
0808 23:39:14.568906 (+ 238us) client_negotiation.cc:240] Negotiation successful
0808 23:39:14.569275 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 23:39:14.577629 19096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb: Bootstrap starting.
I20260808 23:39:14.582979 19096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb: Neither blocks nor log segments found. Creating new log.
I20260808 23:39:14.584635 19096 log.cc:824] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb: Log is configured to *not* fsync() on all Append() calls
I20260808 23:39:14.595064 19096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb: No bootstrap required, opened a new log
I20260808 23:39:14.603752 19096 raft_consensus.cc:348] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } }
I20260808 23:39:14.604313 19096 raft_consensus.cc:729] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036f8cda5d634fa9a7724661691c0cbb, State: Initialized, Role: FOLLOWER
I20260808 23:39:14.604954 19096 consensus_queue.cc:260] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } }
I20260808 23:39:14.606359 19293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } } }
I20260808 23:39:14.607146 19293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:39:14.607803 19096 sys_catalog.cc:564] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:39:14.607967 19071 raft_consensus.cc:482] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 23:39:14.608182 19071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:39:14.613233 19071 raft_consensus.cc:504] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } }
I20260808 23:39:14.616868 19147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "036f8cda5d634fa9a7724661691c0cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "00bd514de80c401f9ccabf9a1aaf1494"
I20260808 23:39:14.617604 19147 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:39:14.622797 19147 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036f8cda5d634fa9a7724661691c0cbb in term 1.
I20260808 23:39:14.624145 19044 leader_election.cc:302] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00bd514de80c401f9ccabf9a1aaf1494, 036f8cda5d634fa9a7724661691c0cbb; no voters:
I20260808 23:39:14.626607 19226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "036f8cda5d634fa9a7724661691c0cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2e2f633370304d6c8642e4034613c317"
I20260808 23:39:14.627352 19226 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:39:14.633404 19226 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036f8cda5d634fa9a7724661691c0cbb in term 1.
I20260808 23:39:14.634691 19071 leader_election.cc:288] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [CANDIDATE]: Term 1 election: Requested vote from peers 00bd514de80c401f9ccabf9a1aaf1494 (127.26.207.253:38377), 2e2f633370304d6c8642e4034613c317 (127.26.207.252:43963)
I20260808 23:39:14.642692 19293 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:39:14.647864 19293 raft_consensus.cc:686] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [term 1 LEADER]: Becoming Leader. State: Replica: 036f8cda5d634fa9a7724661691c0cbb, State: Running, Role: LEADER
I20260808 23:39:14.649550 19293 consensus_queue.cc:237] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } }
I20260808 23:39:14.671404 19301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 036f8cda5d634fa9a7724661691c0cbb. Latest consensus state: current_term: 1 leader_uuid: "036f8cda5d634fa9a7724661691c0cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } } }
I20260808 23:39:14.671931 19301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [sys.catalog]: This master's current role is: LEADER
I20260808 23:39:14.683138 19312 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260808 23:39:14.695010 19125 tablet.cc:2369] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:39:14.716846 19312 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:39:14.741636 19260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.665968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45488 (local address 127.26.207.253:38377)
0808 23:39:14.666177 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:14.666182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:14.675332 (+ 9150us) server_negotiation.cc:407] Connection header received
0808 23:39:14.675893 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:14.675903 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:14.676020 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:14.676118 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:14.691024 (+ 14906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.692332 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.697765 (+ 5433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.698490 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.698618 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:14.718604 (+ 19986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:14.718611 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:14.718616 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:14.718669 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:14.723351 (+ 4682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.734800 (+ 11449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.734808 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.734813 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.735047 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.735965 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.735971 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.735975 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.736443 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:14.736856 (+ 413us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:14.740461 (+ 3605us) server_negotiation.cc:299] Negotiation successful
0808 23:39:14.741080 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 23:39:14.738080 19257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.654601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39696 (local address 127.26.207.254:35653)
0808 23:39:14.654885 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:14.654894 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:14.665002 (+ 10108us) server_negotiation.cc:407] Connection header received
0808 23:39:14.668354 (+ 3352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:14.668365 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:14.668492 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:14.668606 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:14.684960 (+ 16354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.686259 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.696932 (+ 10673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.697764 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.697905 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:14.713056 (+ 15151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:14.713064 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:14.713070 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:14.713128 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:14.717410 (+ 4282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.725078 (+ 7668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.725090 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.725097 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.725371 (+ 274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.726110 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.726118 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.726122 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.726584 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:14.727138 (+ 554us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:14.737273 (+ 10135us) server_negotiation.cc:299] Negotiation successful
0808 23:39:14.737620 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 23:39:14.756006 19254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:14.672021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34046 (local address 127.26.207.252:43963)
0808 23:39:14.672263 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:14.672272 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:14.681521 (+ 9249us) server_negotiation.cc:407] Connection header received
0808 23:39:14.682100 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:14.682111 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:14.682275 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:14.682371 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:14.694409 (+ 12038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.695509 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.707342 (+ 11833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:14.708465 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:14.708642 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:14.727981 (+ 19339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:14.727992 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:14.727998 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:14.728062 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:14.733497 (+ 5435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.739832 (+ 6335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.739859 (+ 27us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.739866 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.740151 (+ 285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:14.744834 (+ 4683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:14.744846 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:14.744852 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:14.745414 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:14.745801 (+ 387us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:14.755181 (+ 9380us) server_negotiation.cc:299] Negotiation successful
0808 23:39:14.755540 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 23:39:14.772567 19147 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494 [term 1 FOLLOWER]: Refusing update from remote peer 036f8cda5d634fa9a7724661691c0cbb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:39:14.774168 19226 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317 [term 1 FOLLOWER]: Refusing update from remote peer 036f8cda5d634fa9a7724661691c0cbb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:39:14.775703 19293 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:39:14.776639 19293 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:39:14.806743 19276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 036f8cda5d634fa9a7724661691c0cbb. Latest consensus state: current_term: 1 leader_uuid: "036f8cda5d634fa9a7724661691c0cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } } }
I20260808 23:39:14.807174 19276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:39:14.815569 19316 mvcc.cc:205] Tried to move back new op lower bound from 7316407725131751424 to 7316407724694470656. Current Snapshot: MvccSnapshot[applied={T|T < 7316407725131751424}]
I20260808 23:39:14.833804 19301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "036f8cda5d634fa9a7724661691c0cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } } }
I20260808 23:39:14.834488 19301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [sys.catalog]: This master's current role is: LEADER
I20260808 23:39:14.836231 19312 catalog_manager.cc:1347] Generated new cluster ID: 44138ced7f15485eac7577747dc8524c
I20260808 23:39:14.836354 19312 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:39:14.836696 19276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "036f8cda5d634fa9a7724661691c0cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } } }
I20260808 23:39:14.837023 19276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:39:14.837188 19317 mvcc.cc:205] Tried to move back new op lower bound from 7316407725131751424 to 7316407724694470656. Current Snapshot: MvccSnapshot[applied={T|T < 7316407725131751424}]
I20260808 23:39:14.852351 19262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 036f8cda5d634fa9a7724661691c0cbb. Latest consensus state: current_term: 1 leader_uuid: "036f8cda5d634fa9a7724661691c0cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } } }
I20260808 23:39:14.852759 19262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:39:14.888388 19293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "036f8cda5d634fa9a7724661691c0cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } } }
I20260808 23:39:14.889011 19293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb [sys.catalog]: This master's current role is: LEADER
I20260808 23:39:14.892071 19312 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:39:14.894215 19312 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:39:14.915306 19262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "036f8cda5d634fa9a7724661691c0cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036f8cda5d634fa9a7724661691c0cbb" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 35653 } } peers { permanent_uuid: "00bd514de80c401f9ccabf9a1aaf1494" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 38377 } } peers { permanent_uuid: "2e2f633370304d6c8642e4034613c317" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 43963 } } }
I20260808 23:39:14.915623 19262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:39:14.920945 19312 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 036f8cda5d634fa9a7724661691c0cbb: Generated new TSK 0
I20260808 23:39:14.922276 19312 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 23:39:15.074939 19257 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:15.058891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39704 (local address 127.26.207.254:35653)
0808 23:39:15.059138 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.059146 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.072300 (+ 13154us) server_negotiation.cc:407] Connection header received
0808 23:39:15.072838 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.072845 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.072958 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.073059 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:15.074580 (+ 1521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39704: BlockingRecv error: recv got EOF from 127.0.0.1:39704 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260808 23:39:15.080070 19260 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:15.071330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45490 (local address 127.26.207.253:38377)
0808 23:39:15.071560 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.071568 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.077049 (+ 5481us) server_negotiation.cc:407] Connection header received
0808 23:39:15.078214 (+ 1165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.078222 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.078354 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.078449 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:15.079768 (+ 1319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45490: BlockingRecv error: recv got EOF from 127.0.0.1:45490 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260808 23:39:15.085430 19254 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:15.082357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34050 (local address 127.26.207.252:43963)
0808 23:39:15.082605 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.082611 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.083175 (+ 564us) server_negotiation.cc:407] Connection header received
0808 23:39:15.083504 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.083513 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.083606 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.083743 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:15.085131 (+ 1388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34050: BlockingRecv error: recv got EOF from 127.0.0.1:34050 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260808 23:39:15.133927 19260 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:15.120443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45502 (local address 127.26.207.253:38377)
0808 23:39:15.120633 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.120639 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.131426 (+ 10787us) server_negotiation.cc:407] Connection header received
0808 23:39:15.132106 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.132113 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.132299 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.132392 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:15.133656 (+ 1264us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45502: BlockingRecv error: recv got EOF from 127.0.0.1:45502 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260808 23:39:15.189234 19260 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:15.175737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45506 (local address 127.26.207.253:38377)
0808 23:39:15.176050 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.176059 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.186966 (+ 10907us) server_negotiation.cc:407] Connection header received
0808 23:39:15.187512 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.187520 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.187638 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.187721 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:15.188926 (+ 1205us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45506: BlockingRecv error: recv got EOF from 127.0.0.1:45506 (error 108)
Metrics: {"server-negotiator.queue_time_us":130}
W20260808 23:39:15.213404 19260 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:15.210860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45510 (local address 127.26.207.253:38377)
0808 23:39:15.211060 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.211069 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.211544 (+ 475us) server_negotiation.cc:407] Connection header received
0808 23:39:15.211890 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.211896 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.211997 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.212128 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:15.213130 (+ 1002us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45510: BlockingRecv error: recv got EOF from 127.0.0.1:45510 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260808 23:39:15.224115 19260 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:15.221843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45512 (local address 127.26.207.253:38377)
0808 23:39:15.222086 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.222101 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.222581 (+ 480us) server_negotiation.cc:407] Connection header received
0808 23:39:15.222754 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.222760 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.222870 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.222999 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:15.223835 (+ 836us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45512: BlockingRecv error: recv got EOF from 127.0.0.1:45512 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
W20260808 23:39:15.239776 19260 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:15.237011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45528 (local address 127.26.207.253:38377)
0808 23:39:15.237343 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.237353 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.237994 (+ 641us) server_negotiation.cc:407] Connection header received
0808 23:39:15.238297 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.238302 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.238397 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.238490 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:15.239476 (+ 986us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45528: BlockingRecv error: recv got EOF from 127.0.0.1:45528 (error 108)
Metrics: {"server-negotiator.queue_time_us":125}
W20260808 23:39:15.262410 19260 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:15.260073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45536 (local address 127.26.207.253:38377)
0808 23:39:15.260373 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.260391 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.260835 (+ 444us) server_negotiation.cc:407] Connection header received
0808 23:39:15.261042 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.261051 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.261153 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.261281 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:15.262067 (+ 786us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45536: BlockingRecv error: recv got EOF from 127.0.0.1:45536 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260808 23:39:15.300814 19260 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:15.298110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45542 (local address 127.26.207.253:38377)
0808 23:39:15.298448 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.298458 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.299027 (+ 569us) server_negotiation.cc:407] Connection header received
0808 23:39:15.299409 (+ 382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.299416 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.299533 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.299667 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:15.300484 (+ 817us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45542: BlockingRecv error: recv got EOF from 127.0.0.1:45542 (error 108)
Metrics: {"server-negotiator.queue_time_us":153}
W20260808 23:39:15.371307 19260 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:15.368949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45556 (local address 127.26.207.253:38377)
0808 23:39:15.369169 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.369176 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.369602 (+ 426us) server_negotiation.cc:407] Connection header received
0808 23:39:15.369888 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.369893 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.369990 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.370123 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:15.371035 (+ 912us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45556: BlockingRecv error: recv got EOF from 127.0.0.1:45556 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 23:39:15.450542 19273 catalog_manager.cc:1259] Loaded cluster ID: 44138ced7f15485eac7577747dc8524c
I20260808 23:39:15.450655 19273 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317: loading cluster ID for follower catalog manager: success
I20260808 23:39:15.453264 19273 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317: acquiring CA information for follower catalog manager: success
I20260808 23:39:15.455164 19273 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2e2f633370304d6c8642e4034613c317: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 23:39:15.506202 19260 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:15.503785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45566 (local address 127.26.207.253:38377)
0808 23:39:15.504103 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.504111 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.504491 (+ 380us) server_negotiation.cc:407] Connection header received
0808 23:39:15.504793 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.504799 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.504886 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.505025 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:15.505911 (+ 886us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45566: BlockingRecv error: recv got EOF from 127.0.0.1:45566 (error 108)
Metrics: {"server-negotiator.queue_time_us":113}
I20260808 23:39:15.514722 19289 catalog_manager.cc:1259] Loaded cluster ID: 44138ced7f15485eac7577747dc8524c
I20260808 23:39:15.514839 19289 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494: loading cluster ID for follower catalog manager: success
I20260808 23:39:15.517674 19289 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494: acquiring CA information for follower catalog manager: success
I20260808 23:39:15.519781 19289 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 00bd514de80c401f9ccabf9a1aaf1494: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 23:39:15.773381 19260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:15.766706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45574 (local address 127.26.207.253:38377)
0808 23:39:15.766965 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.766971 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.767190 (+ 219us) server_negotiation.cc:407] Connection header received
0808 23:39:15.767399 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.767403 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.767566 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.767736 (+ 170us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:39:15.768181 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:15.769003 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:15.770706 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:15.771311 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:15.771448 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:15.772113 (+ 665us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:39:15.772643 (+ 530us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:39:15.772758 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:15.772922 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 23:39:15.773021 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 23:39:15.786382 19393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:15.780028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34062 (local address 127.26.207.252:43963)
0808 23:39:15.780565 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.780574 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.780599 (+ 25us) server_negotiation.cc:407] Connection header received
0808 23:39:15.780906 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.780911 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.781093 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.781295 (+ 202us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:39:15.781754 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:15.782478 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:15.783922 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:15.784349 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:15.784502 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:15.785090 (+ 588us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:39:15.785679 (+ 589us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:39:15.785858 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:15.785952 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 23:39:15.786053 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":253,"threads_started":1}
I20260808 23:39:15.807202 19260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:15.799715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45582 (local address 127.26.207.253:38377)
0808 23:39:15.799902 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.799907 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.800558 (+ 651us) server_negotiation.cc:407] Connection header received
0808 23:39:15.800902 (+ 344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.800908 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.801032 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.801108 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:39:15.801974 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:15.802975 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:15.805127 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:15.805777 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:15.805918 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:15.806333 (+ 415us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:39:15.806483 (+ 150us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:39:15.806571 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:15.806756 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 23:39:15.806851 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 23:39:15.808427 19399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:15.798814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39718 (local address 127.26.207.254:35653)
0808 23:39:15.799396 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.799406 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.799564 (+ 158us) server_negotiation.cc:407] Connection header received
0808 23:39:15.799886 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.799895 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.800174 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.801190 (+ 1016us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:39:15.801361 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:15.802295 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:15.804633 (+ 2338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:15.805313 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:15.805451 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:15.805964 (+ 513us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:39:15.806440 (+ 476us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:39:15.806563 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:15.808019 (+ 1456us) server_negotiation.cc:299] Negotiation successful
0808 23:39:15.808119 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":288,"threads_started":1}
I20260808 23:39:15.809296 19393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:15.800716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34070 (local address 127.26.207.252:43963)
0808 23:39:15.800929 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:15.800934 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:15.801599 (+ 665us) server_negotiation.cc:407] Connection header received
0808 23:39:15.801913 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:15.801922 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:15.802008 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:15.802061 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:39:15.802810 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:15.803620 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:15.807201 (+ 3581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:15.807732 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:15.807910 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:15.808376 (+ 466us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:39:15.808545 (+ 169us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:39:15.808636 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:15.808868 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 23:39:15.808951 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260808 23:39:15.814818 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 19027
I20260808 23:39:15.816021 19091 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:39:15.929567 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 19027
W20260808 23:39:15.957123 19121 connection.cc:535] server connection from 127.0.0.1:45464 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 23:39:15.957544 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 19103
I20260808 23:39:15.958750 19168 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:39:16.073184 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 19103
I20260808 23:39:16.099349 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 19182
I20260808 23:39:16.100713 19246 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:39:16.212014 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 19182
2026-08-08T23:39:16Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5221 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 23:39:16 dist-test-slave-1x4g krb5kdc[19407](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 23:39:16 dist-test-slave-1x4g krb5kdc[19407](info): set up 2 sockets
Aug 08 23:39:16 dist-test-slave-1x4g krb5kdc[19407](info): commencing operation
krb5kdc: starting...
W20260808 23:39:17.425562 27455 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.000s sys 0.060s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/test-user.keytab.
Aug 08 23:39:17 dist-test-slave-1x4g krb5kdc[19407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T23:39:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T23:39:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.207.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
Entry for principal kudu/127.26.207.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab.
I20260808 23:39:17.813802 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:40353
--webserver_interface=127.26.207.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:42591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:40353,127.26.207.253:40355,127.26.207.252:36565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 23:39:18.193594 19420 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 23:39:18.193980 19420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:39:18.194048 19420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:39:18.194155 19420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:39:18.202132 19420 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:39:18.202250 19420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:39:18.202311 19420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:39:18.202356 19420 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:39:18.202423 19420 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:39:18.213698 19420 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:42591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:40353,127.26.207.253:40355,127.26.207.252:36565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.254.keytab
--principal=kudu/127.26.207.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.254:40353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.207.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:39:18.215157 19420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:39:18.216557 19420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:39:18.229981 19426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:18.229984 19428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:18.230732 19425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:39:18.231004 19420 server_base.cc:1034] running on GCE node
I20260808 23:39:18.231957 19420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:39:18.233892 19420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:39:18.235186 19420 hybrid_clock.cc:648] HybridClock initialized: now 1786232358235082 us; error 69 us; skew 500 ppm
I20260808 23:39:18.235612 19420 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:39:18 dist-test-slave-1x4g krb5kdc[19407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232358, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:39:18.239280 19420 init.cc:377] Logged in from keytab as kudu/127.26.207.254@KRBTEST.COM (short username kudu)
I20260808 23:39:18.241146 19420 webserver.cc:460] Webserver started at http://127.26.207.254:34929/ using document root <none> and password file <none>
I20260808 23:39:18.241916 19420 fs_manager.cc:359] Metadata directory not provided
I20260808 23:39:18.242019 19420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:39:18.242309 19420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:39:18.245693 19420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/data/instance:
uuid: "c35d78a67778450d8fbe76e5514eb651"
format_stamp: "Formatted at 2026-08-08 23:39:18 on dist-test-slave-1x4g"
server_key: "3ca0f28728f55b1b27c35ca831544a20"
server_key_iv: "70b5c20aa9ca73e576f5bf8ee3f03d2e"
server_key_version: "encryptionkey@0"
I20260808 23:39:18.246573 19420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/wal/instance:
uuid: "c35d78a67778450d8fbe76e5514eb651"
format_stamp: "Formatted at 2026-08-08 23:39:18 on dist-test-slave-1x4g"
server_key: "3ca0f28728f55b1b27c35ca831544a20"
server_key_iv: "70b5c20aa9ca73e576f5bf8ee3f03d2e"
server_key_version: "encryptionkey@0"
I20260808 23:39:18.252529 19420 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 23:39:18.256573 19435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:39:18.258193 19420 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:39:18.258443 19420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/wal
uuid: "c35d78a67778450d8fbe76e5514eb651"
format_stamp: "Formatted at 2026-08-08 23:39:18 on dist-test-slave-1x4g"
server_key: "3ca0f28728f55b1b27c35ca831544a20"
server_key_iv: "70b5c20aa9ca73e576f5bf8ee3f03d2e"
server_key_version: "encryptionkey@0"
I20260808 23:39:18.258716 19420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:39:18.279486 19420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:39:18.284101 19420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:39:18.284428 19420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:39:18.305717 19420 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.254:40353
I20260808 23:39:18.305742 19487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.254:40353 every 8 connection(s)
I20260808 23:39:18.307266 19420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/data/info.pb
I20260808 23:39:18.311594 19488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:39:18.312162 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 19420
I20260808 23:39:18.312377 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-0/wal/instance
I20260808 23:39:18.312966 27455 external_mini_cluster.cc:1428] Setting key 168ad8ad02df71310de976821b7e600a
I20260808 23:39:18.319325 19488 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:39:18 dist-test-slave-1x4g krb5kdc[19407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232358, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:39:18.350775 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.323136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40353 (local address 127.0.0.1:50850)
0808 23:39:18.324660 (+ 1524us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:18.324714 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:18.327805 (+ 3091us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:18.329056 (+ 1251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:18.329067 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:18.330041 (+ 974us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:18.330575 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:18.330597 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:18.333227 (+ 2630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:18.333232 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:18.334476 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:18.334493 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:18.336038 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:18.336044 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:18.336213 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:18.337108 (+ 895us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:18.337136 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:18.339577 (+ 2441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:18.345088 (+ 5511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:18.345102 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:18.345121 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:18.345633 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:18.346235 (+ 602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:18.346239 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:18.346241 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:18.346569 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:18.347852 (+ 1283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:18.347859 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:18.348082 (+ 223us) client_negotiation.cc:769] Sending connection context
0808 23:39:18.348492 (+ 410us) client_negotiation.cc:240] Negotiation successful
0808 23:39:18.349235 (+ 743us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1180,"mutex_wait_us":188,"spinlock_wait_cycles":24448,"thread_start_us":898,"threads_started":1}
I20260808 23:39:18.350811 19492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.323136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50850 (local address 127.26.207.254:40353)
0808 23:39:18.324293 (+ 1157us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:18.324318 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:18.324901 (+ 583us) server_negotiation.cc:407] Connection header received
0808 23:39:18.328363 (+ 3462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:18.328371 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:18.328685 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:18.328996 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:18.330854 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:18.332997 (+ 2143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:18.334672 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:18.335752 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:18.335985 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:18.339913 (+ 3928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:18.339930 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:18.339952 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:18.340004 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:18.344758 (+ 4754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:18.345810 (+ 1052us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:18.345823 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:18.345830 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:18.346066 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:18.346740 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:18.346748 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:18.346754 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:18.347628 (+ 874us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:18.347888 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:18.348613 (+ 725us) server_negotiation.cc:299] Negotiation successful
0808 23:39:18.349101 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":86,"server-negotiator.queue_time_us":829,"spinlock_wait_cycles":29056,"thread_start_us":533,"threads_started":1}
WARNING: no policy specified for kudu/127.26.207.253@KRBTEST.COM; defaulting to no policy
I20260808 23:39:18.354725 19488 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } has no permanent_uuid. Determining permanent_uuid...
I20260808 23:39:18.356215 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.355650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:40355 (local address 127.0.0.1:36370)
0808 23:39:18.355927 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:18.356064 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.253@KRBTEST.COM" created.
W20260808 23:39:18.356594 19437 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.207.253:40355: connect: Connection refused (error 111)
I20260808 23:39:18.358474 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.358069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:40355 (local address 127.0.0.1:36380)
0808 23:39:18.358232 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:18.358311 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 23:39:18.358711 19488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.253:40355: Network error: Client connection negotiation failed: client connection to 127.26.207.253:40355: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.253.keytab.
Entry for principal kudu/127.26.207.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.253.keytab.
I20260808 23:39:18.401575 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.253:40355
--webserver_interface=127.26.207.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.253.keytab
--principal=kudu/127.26.207.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:42591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:40353,127.26.207.253:40355,127.26.207.252:36565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:39:18.408155 19488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } attempt: 1
I20260808 23:39:18.409829 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.409116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:40355 (local address 127.0.0.1:36384)
0808 23:39:18.409461 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:18.409644 (+ 183us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260808 23:39:18.411363 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.410774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:40355 (local address 127.0.0.1:36394)
0808 23:39:18.410995 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:18.411125 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260808 23:39:18.411708 19488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.253:40355: Network error: Client connection negotiation failed: client connection to 127.26.207.253:40355: connect: Connection refused (error 111)
I20260808 23:39:18.480036 19488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } attempt: 2
I20260808 23:39:18.481475 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.480962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:40355 (local address 127.0.0.1:36396)
0808 23:39:18.481228 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:18.481331 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 23:39:18.482623 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.482146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:40355 (local address 127.0.0.1:36412)
0808 23:39:18.482328 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:18.482428 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 23:39:18.482823 19488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.253:40355: Network error: Client connection negotiation failed: client connection to 127.26.207.253:40355: connect: Connection refused (error 111)
I20260808 23:39:18.574118 19488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } attempt: 3
I20260808 23:39:18.575398 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.574920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:40355 (local address 127.0.0.1:36424)
0808 23:39:18.575142 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:18.575251 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 23:39:18.576545 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.576146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:40355 (local address 127.0.0.1:36436)
0808 23:39:18.576307 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:18.576387 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 23:39:18.576795 19488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.253:40355: Network error: Client connection negotiation failed: client connection to 127.26.207.253:40355: connect: Connection refused (error 111)
I20260808 23:39:18.720124 19488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } attempt: 4
I20260808 23:39:18.721483 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.720884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:40355 (local address 127.0.0.1:36440)
0808 23:39:18.721223 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:18.721322 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199}
I20260808 23:39:18.722569 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.722186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:40355 (local address 127.0.0.1:36446)
0808 23:39:18.722344 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:18.722444 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.253:40355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 23:39:18.722776 19488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.253:40355: Network error: Client connection negotiation failed: client connection to 127.26.207.253:40355: connect: Connection refused (error 111)
W20260808 23:39:18.778366 19496 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 23:39:18.778820 19496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:39:18.778959 19496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:39:18.779106 19496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:39:18.787103 19496 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:39:18.787274 19496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:39:18.787396 19496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:39:18.787494 19496 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:39:18.787621 19496 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:39:18.798466 19496 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:42591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:40353,127.26.207.253:40355,127.26.207.252:36565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.253.keytab
--principal=kudu/127.26.207.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.253:40355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.207.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:39:18.800113 19496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:39:18.801668 19496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:39:18.814767 19501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:18.814699 19504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:18.814677 19502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:39:18.815623 19496 server_base.cc:1034] running on GCE node
I20260808 23:39:18.816623 19496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:39:18.818300 19496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:39:18.819609 19496 hybrid_clock.cc:648] HybridClock initialized: now 1786232358819509 us; error 70 us; skew 500 ppm
I20260808 23:39:18.819983 19496 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:39:18 dist-test-slave-1x4g krb5kdc[19407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232358, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:39:18.823405 19496 init.cc:377] Logged in from keytab as kudu/127.26.207.253@KRBTEST.COM (short username kudu)
I20260808 23:39:18.825248 19496 webserver.cc:460] Webserver started at http://127.26.207.253:44861/ using document root <none> and password file <none>
I20260808 23:39:18.826067 19496 fs_manager.cc:359] Metadata directory not provided
I20260808 23:39:18.826222 19496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:39:18.826587 19496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:39:18.831633 19496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/data/instance:
uuid: "babe4adfe1ad437e806593b52d17fa11"
format_stamp: "Formatted at 2026-08-08 23:39:18 on dist-test-slave-1x4g"
server_key: "f373a67896115184ad7758f8c2559c99"
server_key_iv: "8d38cc3f3c84a780ba3623c519d43428"
server_key_version: "encryptionkey@0"
I20260808 23:39:18.832927 19496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/wal/instance:
uuid: "babe4adfe1ad437e806593b52d17fa11"
format_stamp: "Formatted at 2026-08-08 23:39:18 on dist-test-slave-1x4g"
server_key: "f373a67896115184ad7758f8c2559c99"
server_key_iv: "8d38cc3f3c84a780ba3623c519d43428"
server_key_version: "encryptionkey@0"
I20260808 23:39:18.840411 19496 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260808 23:39:18.844691 19511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:39:18.846356 19496 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 23:39:18.846613 19496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/wal
uuid: "babe4adfe1ad437e806593b52d17fa11"
format_stamp: "Formatted at 2026-08-08 23:39:18 on dist-test-slave-1x4g"
server_key: "f373a67896115184ad7758f8c2559c99"
server_key_iv: "8d38cc3f3c84a780ba3623c519d43428"
server_key_version: "encryptionkey@0"
I20260808 23:39:18.846889 19496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:39:18.862746 19496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:39:18.867581 19496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:39:18.867902 19496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:39:18.888269 19496 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.253:40355
I20260808 23:39:18.888293 19563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.253:40355 every 8 connection(s)
I20260808 23:39:18.889853 19496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/data/info.pb
I20260808 23:39:18.891855 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 19496
I20260808 23:39:18.892091 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-1/wal/instance
I20260808 23:39:18.892645 27455 external_mini_cluster.cc:1428] Setting key d9598c52bc3b7bae875d72d2e87fb6b3
I20260808 23:39:18.894877 19564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:39:18.906275 19564 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:39:18 dist-test-slave-1x4g krb5kdc[19407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232358, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.253@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.207.252@KRBTEST.COM; defaulting to no policy
I20260808 23:39:18.930981 19567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.910283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50854 (local address 127.26.207.254:40353)
0808 23:39:18.910851 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:18.910856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:18.912191 (+ 1335us) server_negotiation.cc:407] Connection header received
0808 23:39:18.914500 (+ 2309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:18.914506 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:18.914612 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:18.914748 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:18.916571 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:18.917409 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:18.919107 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:18.919536 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:18.919687 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:18.923641 (+ 3954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:18.923646 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:18.923649 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:18.923700 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:18.927210 (+ 3510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:18.928200 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:18.928208 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:18.928212 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:18.928363 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:18.929049 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:18.929053 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:18.929055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:18.929368 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:18.929541 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:18.930389 (+ 848us) server_negotiation.cc:299] Negotiation successful
0808 23:39:18.930618 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":321,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.207.252@KRBTEST.COM" created.
I20260808 23:39:18.931922 19568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.911114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40353 (local address 127.0.0.1:50854)
0808 23:39:18.911992 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:18.912035 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:18.914142 (+ 2107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:18.915040 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:18.915050 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:18.915669 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:18.916297 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:18.916318 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:18.917615 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:18.917619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:18.918923 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:18.918938 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:18.919803 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:18.919811 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:18.920077 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:18.920938 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:18.920970 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:18.923327 (+ 2357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:18.927452 (+ 4125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:18.927465 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:18.927493 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:18.928040 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:18.928552 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:18.928558 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:18.928562 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:18.928916 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:18.929549 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:18.929561 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:18.929964 (+ 403us) client_negotiation.cc:769] Sending connection context
0808 23:39:18.930213 (+ 249us) client_negotiation.cc:240] Negotiation successful
0808 23:39:18.930688 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":374,"threads_started":1}
I20260808 23:39:18.934149 19564 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:39:18 dist-test-slave-1x4g krb5kdc[19407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232358, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.253@KRBTEST.COM for kudu/127.26.207.253@KRBTEST.COM
I20260808 23:39:18.953212 19568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.935015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:40355 (local address 127.0.0.1:36452)
0808 23:39:18.935289 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:18.935314 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:18.935453 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:18.936584 (+ 1131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:18.936596 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:18.937234 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:18.937476 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:18.937492 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:18.939099 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:18.939108 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:18.940604 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:18.940627 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:18.941732 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:18.941741 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:18.941967 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:18.942867 (+ 900us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:18.942896 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:18.945862 (+ 2966us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:18.950193 (+ 4331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:18.950198 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:18.950202 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:18.950681 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:18.951181 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:18.951187 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:18.951191 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:18.951352 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:18.952024 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:18.952030 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:18.952226 (+ 196us) client_negotiation.cc:769] Sending connection context
0808 23:39:18.952389 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 23:39:18.952769 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 23:39:18.953372 19569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.935362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36452 (local address 127.26.207.253:40355)
0808 23:39:18.936090 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:18.936097 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:18.936127 (+ 30us) server_negotiation.cc:407] Connection header received
0808 23:39:18.936178 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:18.936185 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:18.936389 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:18.936518 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:18.937724 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:18.938912 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:18.940872 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:18.941535 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:18.941655 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:18.946182 (+ 4527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:18.946209 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:18.946235 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:18.946285 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:18.949966 (+ 3681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:18.950827 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:18.950835 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:18.950838 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:18.951053 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:18.951473 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:18.951479 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:18.951483 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:18.951879 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:18.952132 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:18.952552 (+ 420us) server_negotiation.cc:299] Negotiation successful
0808 23:39:18.952964 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":90,"server-negotiator.queue_time_us":554,"thread_start_us":412,"threads_started":1}
I20260808 23:39:18.956634 19564 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } has no permanent_uuid. Determining permanent_uuid...
I20260808 23:39:18.958119 19568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.957552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58588)
0808 23:39:18.957777 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:18.957929 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
W20260808 23:39:18.958431 19515 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
I20260808 23:39:18.960307 19568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:18.959879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58594)
0808 23:39:18.960078 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:18.960176 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 23:39:18.960567 19564 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:36565: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.207.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.252.keytab.
Entry for principal kudu/127.26.207.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.252.keytab.
I20260808 23:39:18.981074 27455 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
/tmp/dist-test-taskWgS6PY/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.252:36565
--webserver_interface=127.26.207.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.252.keytab
--principal=kudu/127.26.207.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.207.212:42591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.207.254:40353,127.26.207.253:40355,127.26.207.252:36565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 23:39:19.009879 19564 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } attempt: 1
I20260808 23:39:19.011263 19568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.010581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58598)
0808 23:39:19.010878 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.011031 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260808 23:39:19.012601 19568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.012075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58610)
0808 23:39:19.012291 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.012411 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 23:39:19.012912 19564 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:36565: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
I20260808 23:39:19.022039 19488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } attempt: 5
Aug 08 23:39:19 dist-test-slave-1x4g krb5kdc[19407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232358, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for kudu/127.26.207.253@KRBTEST.COM
I20260808 23:39:19.037513 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.022899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:40355 (local address 127.0.0.1:36458)
0808 23:39:19.023151 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.023175 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:19.023330 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:19.023754 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:19.023760 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:19.024196 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:19.024434 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:19.024449 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.025675 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.025681 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:19.026599 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:19.026612 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.027460 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.027468 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:19.027699 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.028392 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:19.028411 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:19.030861 (+ 2450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:19.034384 (+ 3523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:19.034391 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:19.034396 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:19.034875 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:19.035366 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:19.035372 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:19.035375 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:19.035551 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:19.036252 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:19.036261 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:19.036487 (+ 226us) client_negotiation.cc:769] Sending connection context
0808 23:39:19.036676 (+ 189us) client_negotiation.cc:240] Negotiation successful
0808 23:39:19.037108 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 23:39:19.037559 19569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.023019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36458 (local address 127.26.207.253:40355)
0808 23:39:19.023235 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:19.023240 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:19.023264 (+ 24us) server_negotiation.cc:407] Connection header received
0808 23:39:19.023518 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:19.023523 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:19.023591 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:19.023713 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:19.024652 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.025522 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.026784 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.027270 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.027424 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.031124 (+ 3700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:19.031130 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:19.031133 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:19.031170 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:19.034176 (+ 3006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.035039 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.035048 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.035056 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.035223 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.035685 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.035690 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.035694 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.036026 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:19.036315 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:19.036845 (+ 530us) server_negotiation.cc:299] Negotiation successful
0808 23:39:19.037252 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 23:39:19.038872 19488 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } has no permanent_uuid. Determining permanent_uuid...
I20260808 23:39:19.040369 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.039878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58622)
0808 23:39:19.040101 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.040216 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 23:39:19.041710 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.041278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58630)
0808 23:39:19.041492 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.041572 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260808 23:39:19.041976 19488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:36565: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
I20260808 23:39:19.081187 19564 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } attempt: 2
I20260808 23:39:19.082684 19568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.081974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58640)
0808 23:39:19.082274 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.082426 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260808 23:39:19.084100 19568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.083645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58644)
0808 23:39:19.083827 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.083927 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 23:39:19.084367 19564 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:36565: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
I20260808 23:39:19.093248 19488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } attempt: 1
I20260808 23:39:19.094645 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.094136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58654)
0808 23:39:19.094362 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.094462 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 23:39:19.095839 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.095434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58666)
0808 23:39:19.095619 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.095702 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260808 23:39:19.096190 19488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:36565: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
I20260808 23:39:19.164475 19488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } attempt: 2
I20260808 23:39:19.165970 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.165406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58682)
0808 23:39:19.165670 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.165766 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260808 23:39:19.167156 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.166765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58692)
0808 23:39:19.166946 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.167023 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 23:39:19.167455 19488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:36565: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
I20260808 23:39:19.175668 19564 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } attempt: 3
I20260808 23:39:19.177254 19568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.176420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58696)
0808 23:39:19.176811 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.176973 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260808 23:39:19.178817 19568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.178140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58706)
0808 23:39:19.178454 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.178605 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168}
W20260808 23:39:19.179108 19564 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:36565: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
I20260808 23:39:19.273738 19488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } attempt: 3
I20260808 23:39:19.275164 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.274585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58722)
0808 23:39:19.274829 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.274930 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260808 23:39:19.276415 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.275975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58736)
0808 23:39:19.276197 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.276292 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
W20260808 23:39:19.276662 19488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:36565: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
I20260808 23:39:19.322387 19564 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } attempt: 4
I20260808 23:39:19.323743 19568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.323082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58738)
0808 23:39:19.323379 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.323505 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 23:39:19.324961 19568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.324471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:58750)
0808 23:39:19.324662 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.324765 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 23:39:19.325199 19564 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:36565: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
W20260808 23:39:19.376277 19572 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 23:39:19.376719 19572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 23:39:19.376897 19572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 23:39:19.377041 19572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 23:39:19.385031 19572 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 23:39:19.385155 19572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 23:39:19.385257 19572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 23:39:19.385346 19572 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 23:39:19.385468 19572 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 23:39:19.396178 19572 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.207.212:42591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.207.254:40353,127.26.207.253:40355,127.26.207.252:36565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/krb5kdc/kudu_127.26.207.252.keytab
--principal=kudu/127.26.207.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.207.252:36565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.207.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 22:27:01 UTC on ccycloud.quasar-rdhpdq.root.comops.site
build id 4575491
ASAN enabled
I20260808 23:39:19.397794 19572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 23:39:19.399343 19572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 23:39:19.412511 19578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:19.412600 19580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 23:39:19.412635 19577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 23:39:19.413479 19572 server_base.cc:1034] running on GCE node
I20260808 23:39:19.414395 19572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 23:39:19.416000 19572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 23:39:19.417294 19572 hybrid_clock.cc:648] HybridClock initialized: now 1786232359417214 us; error 51 us; skew 500 ppm
I20260808 23:39:19.417691 19572 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 23:39:19 dist-test-slave-1x4g krb5kdc[19407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232359, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 23:39:19.421288 19572 init.cc:377] Logged in from keytab as kudu/127.26.207.252@KRBTEST.COM (short username kudu)
I20260808 23:39:19.422876 19572 webserver.cc:460] Webserver started at http://127.26.207.252:38441/ using document root <none> and password file <none>
I20260808 23:39:19.423652 19572 fs_manager.cc:359] Metadata directory not provided
I20260808 23:39:19.423749 19572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 23:39:19.424046 19572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 23:39:19.427455 19572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/data/instance:
uuid: "2a1a9d0710ad472ba45e39f092eb5f20"
format_stamp: "Formatted at 2026-08-08 23:39:19 on dist-test-slave-1x4g"
server_key: "fd7e1764fde823274d46906b0eff13b9"
server_key_iv: "ad9664f041c688d350783d3251bd24b0"
server_key_version: "encryptionkey@0"
I20260808 23:39:19.428486 19572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/wal/instance:
uuid: "2a1a9d0710ad472ba45e39f092eb5f20"
format_stamp: "Formatted at 2026-08-08 23:39:19 on dist-test-slave-1x4g"
server_key: "fd7e1764fde823274d46906b0eff13b9"
server_key_iv: "ad9664f041c688d350783d3251bd24b0"
server_key_version: "encryptionkey@0"
I20260808 23:39:19.434465 19572 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260808 23:39:19.438501 19587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 23:39:19.440171 19572 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 23:39:19.440349 19572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/data,/tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/wal
uuid: "2a1a9d0710ad472ba45e39f092eb5f20"
format_stamp: "Formatted at 2026-08-08 23:39:19 on dist-test-slave-1x4g"
server_key: "fd7e1764fde823274d46906b0eff13b9"
server_key_iv: "ad9664f041c688d350783d3251bd24b0"
server_key_version: "encryptionkey@0"
I20260808 23:39:19.440563 19572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 23:39:19.453888 19488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } attempt: 4
I20260808 23:39:19.455170 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.454612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:47688)
0808 23:39:19.454862 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.454975 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260808 23:39:19.456348 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.455900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:47692)
0808 23:39:19.456079 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.456195 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260808 23:39:19.456696 19488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.207.252:36565: Network error: Client connection negotiation failed: client connection to 127.26.207.252:36565: connect: Connection refused (error 111)
I20260808 23:39:19.457710 19572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 23:39:19.462734 19572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 23:39:19.463099 19572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 23:39:19.483556 19572 rpc_server.cc:307] RPC server started. Bound to: 127.26.207.252:36565
I20260808 23:39:19.483574 19640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.207.252:36565 every 8 connection(s)
I20260808 23:39:19.485162 19572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/data/info.pb
I20260808 23:39:19.489283 19642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 23:39:19.489980 27455 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu as pid 19572
I20260808 23:39:19.490195 27455 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWgS6PY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786231963826981-27455-0/minicluster-data/master-2/wal/instance
I20260808 23:39:19.490711 27455 external_mini_cluster.cc:1428] Setting key d7543d4ed7c2090d676cba4124d53993
I20260808 23:39:19.500703 19642 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:39:19 dist-test-slave-1x4g krb5kdc[19407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.252@KRBTEST.COM
Aug 08 23:39:19 dist-test-slave-1x4g krb5kdc[19407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232359, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.252@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
I20260808 23:39:19.519616 19645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.492835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47700 (local address 127.26.207.252:36565)
0808 23:39:19.493789 (+ 954us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:19.493812 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:19.493871 (+ 59us) server_negotiation.cc:407] Connection header received
0808 23:39:19.496762 (+ 2891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:19.496835 (+ 73us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:19.497546 (+ 711us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:19.498097 (+ 551us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:19.499697 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.501909 (+ 2212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.503768 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.505063 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.505308 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.510515 (+ 5207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:19.510525 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:19.510539 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:19.510596 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:19.514774 (+ 4178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.515698 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.515713 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.515721 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.515894 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.516351 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.516356 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.516361 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.517097 (+ 736us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:19.517442 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:19.517950 (+ 508us) server_negotiation.cc:299] Negotiation successful
0808 23:39:19.518429 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":665,"thread_start_us":359,"threads_started":1}
I20260808 23:39:19.521968 19647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.504292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.254:40353 (local address 127.0.0.1:33716)
0808 23:39:19.505372 (+ 1080us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.505421 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:19.505605 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:19.506182 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:19.506194 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:19.507209 (+ 1015us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:19.507628 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:19.507648 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.509002 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.509007 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:19.510250 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:19.510266 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.511187 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.511195 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:19.511383 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.512118 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:19.512168 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:19.515171 (+ 3003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:19.518817 (+ 3646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:19.518829 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:19.518837 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:19.519323 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:19.519765 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:19.519770 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:19.519774 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:19.519969 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:19.520730 (+ 761us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:19.520738 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:19.520992 (+ 254us) client_negotiation.cc:769] Sending connection context
0808 23:39:19.521326 (+ 334us) client_negotiation.cc:240] Negotiation successful
0808 23:39:19.521629 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":785,"thread_start_us":591,"threads_started":1}
I20260808 23:39:19.522367 19646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.504221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33716 (local address 127.26.207.254:40353)
0808 23:39:19.504895 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:19.504902 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:19.505574 (+ 672us) server_negotiation.cc:407] Connection header received
0808 23:39:19.505793 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:19.505798 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:19.505899 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:19.506026 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:19.507874 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.508777 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.510452 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.510908 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.511079 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.515450 (+ 4371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:19.515456 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:19.515459 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:19.515503 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:19.518665 (+ 3162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.519466 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.519474 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.519483 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.519635 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.520132 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.520219 (+ 87us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.520227 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.520568 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:19.520711 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:19.521518 (+ 807us) server_negotiation.cc:299] Negotiation successful
0808 23:39:19.521803 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":268,"threads_started":1}
I20260808 23:39:19.524183 19642 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:39:19 dist-test-slave-1x4g krb5kdc[19407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.254@KRBTEST.COM
Aug 08 23:39:19 dist-test-slave-1x4g krb5kdc[19407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232359, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.252@KRBTEST.COM for kudu/127.26.207.253@KRBTEST.COM
I20260808 23:39:19.542608 19647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.525205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.253:40355 (local address 127.0.0.1:51534)
0808 23:39:19.525381 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.525400 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:19.525536 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:19.525889 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:19.525895 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:19.526426 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:19.526624 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:19.526639 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.528413 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.528421 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:19.530303 (+ 1882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:19.530322 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.531368 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.531373 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:19.531541 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.532146 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:19.532166 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:19.535085 (+ 2919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:19.539293 (+ 4208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:19.539299 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:19.539302 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:19.539999 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:19.540576 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:19.540582 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:19.540586 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:19.540774 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:19.541494 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:19.541500 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:19.541723 (+ 223us) client_negotiation.cc:769] Sending connection context
0808 23:39:19.541883 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 23:39:19.542245 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 23:39:19.542654 19646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.523962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33720 (local address 127.26.207.254:40353)
0808 23:39:19.524141 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:19.524148 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:19.524211 (+ 63us) server_negotiation.cc:407] Connection header received
0808 23:39:19.524394 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:19.524399 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:19.524494 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:19.524609 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:19.526203 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.527148 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.528949 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.529803 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.529938 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.535054 (+ 5116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:19.535060 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:19.535064 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:19.535108 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:19.539068 (+ 3960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.540202 (+ 1134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.540209 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.540214 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.540422 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.540924 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.540929 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.540932 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.541325 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:19.541635 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:19.542030 (+ 395us) server_negotiation.cc:299] Negotiation successful
0808 23:39:19.542313 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 23:39:19.543080 19569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.525133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51534 (local address 127.26.207.253:40355)
0808 23:39:19.525314 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:19.525320 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:19.525477 (+ 157us) server_negotiation.cc:407] Connection header received
0808 23:39:19.525675 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:19.525687 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:19.525751 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:19.525860 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:19.526892 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.528094 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.530500 (+ 2406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.531174 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.531327 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.535328 (+ 4001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:19.535335 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:19.535340 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:19.535386 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:19.539019 (+ 3633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.540190 (+ 1171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.540197 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.540200 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.540422 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.540918 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.540922 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.540926 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.541325 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:19.541493 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:19.542030 (+ 537us) server_negotiation.cc:299] Negotiation successful
0808 23:39:19.542299 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 23:39:19.544204 19642 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 23:39:19 dist-test-slave-1x4g krb5kdc[19407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232359, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.252@KRBTEST.COM for kudu/127.26.207.252@KRBTEST.COM
Aug 08 23:39:19 dist-test-slave-1x4g krb5kdc[19407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.207.253@KRBTEST.COM
I20260808 23:39:19.561338 19645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.545294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47716 (local address 127.26.207.252:36565)
0808 23:39:19.545493 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:19.545497 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:19.545752 (+ 255us) server_negotiation.cc:407] Connection header received
0808 23:39:19.545904 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:19.545911 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:19.545990 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:19.546099 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:19.546912 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.547792 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.549294 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.550001 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.550109 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.554416 (+ 4307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:19.554426 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:19.554431 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:19.554483 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:19.558244 (+ 3761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.559012 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.559019 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.559022 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.559181 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.559574 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.559578 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.559582 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.560018 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:19.560188 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:19.560619 (+ 431us) server_negotiation.cc:299] Negotiation successful
0808 23:39:19.560900 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 23:39:19.561435 19647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.545377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:47716)
0808 23:39:19.545659 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.545678 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:19.545784 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:19.546130 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:19.546134 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:19.546522 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:19.546752 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:19.546761 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.547939 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.547945 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:19.549129 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:19.549145 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.550174 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.550183 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:19.550417 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.551223 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:19.551242 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:19.554086 (+ 2844us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:19.558427 (+ 4341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:19.558431 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:19.558434 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:19.558855 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:19.559309 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:19.559312 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:19.559314 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:19.559455 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:19.560172 (+ 717us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:19.560180 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:19.560370 (+ 190us) client_negotiation.cc:769] Sending connection context
0808 23:39:19.560553 (+ 183us) client_negotiation.cc:240] Negotiation successful
0808 23:39:19.561065 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":178}
I20260808 23:39:19.563359 19569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.544752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51538 (local address 127.26.207.253:40355)
0808 23:39:19.545045 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:19.545051 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:19.545073 (+ 22us) server_negotiation.cc:407] Connection header received
0808 23:39:19.545458 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:19.545463 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:19.545549 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:19.545659 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:19.547345 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.548263 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.549856 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.550545 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.550766 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.556221 (+ 5455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:19.556229 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:19.556234 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:19.556289 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:19.559820 (+ 3531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.560915 (+ 1095us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.560921 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.560924 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.561119 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.561677 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.561681 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.561684 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.561975 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:19.562256 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:19.562690 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 23:39:19.562958 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
I20260808 23:39:19.568176 19642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20: Bootstrap starting.
I20260808 23:39:19.568909 27455 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 23:39:19.571883 19642 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20: Neither blocks nor log segments found. Creating new log.
I20260808 23:39:19.573189 19642 log.cc:824] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20: Log is configured to *not* fsync() on all Append() calls
I20260808 23:39:19.571530 19463 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c35d78a67778450d8fbe76e5514eb651"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33720
I20260808 23:39:19.576457 19642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20: No bootstrap required, opened a new log
I20260808 23:39:19.584234 19642 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } }
I20260808 23:39:19.584687 19642 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a1a9d0710ad472ba45e39f092eb5f20, State: Initialized, Role: FOLLOWER
I20260808 23:39:19.585250 19642 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } }
I20260808 23:39:19.586428 19649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } } }
I20260808 23:39:19.586882 19649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:39:19.587700 19642 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 23:39:19.598964 19662 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 23:39:19.599251 19662 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 23:39:19.596266 19572 master_runner.cc:186] Error getting master registration for 127.26.207.254:40353: OK, instance_id { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" instance_seqno: 1786232358299678 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 23:39:19.607247 19572 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 23:39:19.624472 19564 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } attempt: 5
Aug 08 23:39:19 dist-test-slave-1x4g krb5kdc[19407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232358, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.253@KRBTEST.COM for kudu/127.26.207.252@KRBTEST.COM
I20260808 23:39:19.641352 19568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.625341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:47730)
0808 23:39:19.625548 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.625572 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:19.625716 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:19.626190 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:19.626197 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:19.626757 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:19.627001 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:19.627026 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.628240 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.628247 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:19.629258 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:19.629273 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.630111 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.630120 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:19.630370 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.631117 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:19.631147 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:19.633953 (+ 2806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:19.638119 (+ 4166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:19.638126 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:19.638131 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:19.638736 (+ 605us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:19.639247 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:19.639252 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:19.639256 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:19.639488 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:19.640204 (+ 716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:19.640208 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:19.640390 (+ 182us) client_negotiation.cc:769] Sending connection context
0808 23:39:19.640555 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 23:39:19.640935 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 23:39:19.641386 19645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.625430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47730 (local address 127.26.207.252:36565)
0808 23:39:19.625723 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:19.625729 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:19.625754 (+ 25us) server_negotiation.cc:407] Connection header received
0808 23:39:19.625865 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:19.625870 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:19.625967 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:19.626078 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:19.627209 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.628047 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.629424 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.629921 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.630077 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.634215 (+ 4138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:19.634221 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:19.634224 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:19.634265 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:19.637900 (+ 3635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.638898 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.638904 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.638908 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.639105 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.639624 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.639629 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.639633 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.640066 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:19.640244 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:19.640713 (+ 469us) server_negotiation.cc:299] Negotiation successful
0808 23:39:19.641002 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145}
I20260808 23:39:19.648337 19564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11: Bootstrap starting.
I20260808 23:39:19.653210 19564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11: Neither blocks nor log segments found. Creating new log.
I20260808 23:39:19.654686 19564 log.cc:824] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11: Log is configured to *not* fsync() on all Append() calls
I20260808 23:39:19.658674 19564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11: No bootstrap required, opened a new log
I20260808 23:39:19.670478 19564 raft_consensus.cc:348] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } }
I20260808 23:39:19.671046 19564 raft_consensus.cc:729] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: babe4adfe1ad437e806593b52d17fa11, State: Initialized, Role: FOLLOWER
I20260808 23:39:19.671676 19564 consensus_queue.cc:260] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } }
I20260808 23:39:19.672925 19665 sys_catalog.cc:455] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } } }
I20260808 23:39:19.673385 19665 sys_catalog.cc:458] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:39:19.674369 19564 sys_catalog.cc:564] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 23:39:19.685765 19676 catalog_manager.cc:1558] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 23:39:19.686059 19676 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 23:39:19.682557 19496 master_runner.cc:186] Error getting master registration for 127.26.207.254:40353: OK, instance_id { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" instance_seqno: 1786232358299678 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 23:39:19.695006 19496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 23:39:19.715716 19593 tablet.cc:2369] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:39:19.733937 19488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } attempt: 5
Aug 08 23:39:19 dist-test-slave-1x4g krb5kdc[19407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786232358, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.207.254@KRBTEST.COM for kudu/127.26.207.252@KRBTEST.COM
I20260808 23:39:19.751475 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.734800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.207.252:36565 (local address 127.0.0.1:47732)
0808 23:39:19.735097 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 23:39:19.735119 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 23:39:19.735295 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 23:39:19.735720 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 23:39:19.735728 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 23:39:19.736302 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0808 23:39:19.736551 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:19.736564 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.737750 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.737758 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:19.739346 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 23:39:19.739364 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.740216 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.740223 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 23:39:19.740458 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.741229 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 23:39:19.741257 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 23:39:19.744289 (+ 3032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 23:39:19.748283 (+ 3994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:19.748293 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:19.748297 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:19.748910 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:19.749361 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 23:39:19.749368 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 23:39:19.749372 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 23:39:19.749582 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 23:39:19.750319 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 23:39:19.750324 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 23:39:19.750534 (+ 210us) client_negotiation.cc:769] Sending connection context
0808 23:39:19.750699 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 23:39:19.751046 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182}
I20260808 23:39:19.751689 19645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.734853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47732 (local address 127.26.207.252:36565)
0808 23:39:19.735067 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:19.735073 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:19.735227 (+ 154us) server_negotiation.cc:407] Connection header received
0808 23:39:19.735461 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:19.735466 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:19.735552 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:19.735674 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:19.736724 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.737585 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.739510 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.740039 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.740192 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.744597 (+ 4405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:19.744602 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:19.744606 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:19.744644 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:19.748086 (+ 3442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.749050 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.749056 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.749059 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.749224 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.749721 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.749726 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.749729 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.750105 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:19.750252 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:19.750816 (+ 564us) server_negotiation.cc:299] Negotiation successful
0808 23:39:19.751136 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 23:39:19.757109 19488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651: Bootstrap starting.
I20260808 23:39:19.761636 19488 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651: Neither blocks nor log segments found. Creating new log.
I20260808 23:39:19.763137 19488 log.cc:824] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651: Log is configured to *not* fsync() on all Append() calls
I20260808 23:39:19.766981 19488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651: No bootstrap required, opened a new log
I20260808 23:39:19.775497 19488 raft_consensus.cc:348] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } }
I20260808 23:39:19.775985 19488 raft_consensus.cc:729] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c35d78a67778450d8fbe76e5514eb651, State: Initialized, Role: FOLLOWER
I20260808 23:39:19.776655 19488 consensus_queue.cc:260] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } }
I20260808 23:39:19.778421 19681 sys_catalog.cc:455] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } } }
I20260808 23:39:19.779210 19681 sys_catalog.cc:458] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:39:19.779640 19488 sys_catalog.cc:564] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 23:39:19.779743 19463 raft_consensus.cc:482] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 23:39:19.779950 19463 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:39:19.784564 19463 raft_consensus.cc:504] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } }
I20260808 23:39:19.788168 19539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c35d78a67778450d8fbe76e5514eb651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "babe4adfe1ad437e806593b52d17fa11"
W20260808 23:39:19.789109 19442 tablet.cc:2369] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:39:19.790699 19539 raft_consensus.cc:3037] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:39:19.796288 19539 raft_consensus.cc:2454] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c35d78a67778450d8fbe76e5514eb651 in term 1.
I20260808 23:39:19.798377 19615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c35d78a67778450d8fbe76e5514eb651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2a1a9d0710ad472ba45e39f092eb5f20"
I20260808 23:39:19.799114 19615 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20 [term 0 FOLLOWER]: Advancing to term 1
I20260808 23:39:19.804301 19615 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c35d78a67778450d8fbe76e5514eb651 in term 1.
I20260808 23:39:19.805650 19440 leader_election.cc:302] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a1a9d0710ad472ba45e39f092eb5f20, c35d78a67778450d8fbe76e5514eb651; no voters:
I20260808 23:39:19.807263 19463 leader_election.cc:288] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [CANDIDATE]: Term 1 election: Requested vote from peers babe4adfe1ad437e806593b52d17fa11 (127.26.207.253:40355), 2a1a9d0710ad472ba45e39f092eb5f20 (127.26.207.252:36565)
I20260808 23:39:19.815276 19681 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 23:39:19.830204 19681 raft_consensus.cc:686] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [term 1 LEADER]: Becoming Leader. State: Replica: c35d78a67778450d8fbe76e5514eb651, State: Running, Role: LEADER
I20260808 23:39:19.831291 19681 consensus_queue.cc:237] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } }
I20260808 23:39:19.866040 19690 sys_catalog.cc:455] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c35d78a67778450d8fbe76e5514eb651. Latest consensus state: current_term: 1 leader_uuid: "c35d78a67778450d8fbe76e5514eb651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } } }
I20260808 23:39:19.866828 19690 sys_catalog.cc:458] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [sys.catalog]: This master's current role is: LEADER
W20260808 23:39:19.871001 19517 tablet.cc:2369] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 23:39:19.872277 19704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 23:39:19.873493 19703 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 23:39:19.893683 19645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.838625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47742 (local address 127.26.207.252:36565)
0808 23:39:19.838901 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:19.838911 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:19.861588 (+ 22677us) server_negotiation.cc:407] Connection header received
0808 23:39:19.862178 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:19.862185 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:19.862279 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:19.862354 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:19.865260 (+ 2906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.866399 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.868492 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.869263 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.869382 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.884996 (+ 15614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:19.885003 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:19.885009 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:19.885065 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:19.889216 (+ 4151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.890290 (+ 1074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.890296 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.890300 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.890470 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.891025 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.891034 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.891038 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.891470 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:19.891780 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:19.892948 (+ 1168us) server_negotiation.cc:299] Negotiation successful
0808 23:39:19.893237 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 23:39:19.901260 19569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.837083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51544 (local address 127.26.207.253:40355)
0808 23:39:19.837290 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:19.837297 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:19.846647 (+ 9350us) server_negotiation.cc:407] Connection header received
0808 23:39:19.847354 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:19.847364 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:19.847489 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:19.847591 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:19.857997 (+ 10406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.859666 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.874748 (+ 15082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.875743 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.875876 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.885624 (+ 9748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:19.885631 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:19.885635 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:19.885682 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:19.890289 (+ 4607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.897954 (+ 7665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.897962 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.897966 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.898205 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.898766 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.898774 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.898780 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.899342 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:19.899660 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:19.900468 (+ 808us) server_negotiation.cc:299] Negotiation successful
0808 23:39:19.900839 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 23:39:19.913504 19704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 23:39:19.917078 19646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:19.837116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33724 (local address 127.26.207.254:40353)
0808 23:39:19.837495 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:19.837502 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:19.846456 (+ 8954us) server_negotiation.cc:407] Connection header received
0808 23:39:19.848955 (+ 2499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:19.848966 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:19.849112 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:19.849216 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:19.862485 (+ 13269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.864188 (+ 1703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.874812 (+ 10624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:19.875721 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:19.875861 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:19.898012 (+ 22151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 23:39:19.898019 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 23:39:19.898025 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 23:39:19.898101 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0808 23:39:19.902176 (+ 4075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.913866 (+ 11690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.913874 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.913879 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.914147 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 23:39:19.914786 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 23:39:19.914793 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 23:39:19.914797 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 23:39:19.915253 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 23:39:19.915577 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:19.916273 (+ 696us) server_negotiation.cc:299] Negotiation successful
0808 23:39:19.916591 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214}
I20260808 23:39:19.951102 19615 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20 [term 1 FOLLOWER]: Refusing update from remote peer c35d78a67778450d8fbe76e5514eb651: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:39:19.952553 19690 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:39:19.954831 19539 raft_consensus.cc:1261] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11 [term 1 FOLLOWER]: Refusing update from remote peer c35d78a67778450d8fbe76e5514eb651: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 23:39:19.956626 19690 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 23:39:19.991406 19649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c35d78a67778450d8fbe76e5514eb651. Latest consensus state: current_term: 1 leader_uuid: "c35d78a67778450d8fbe76e5514eb651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } } }
I20260808 23:39:19.991816 19649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:39:20.010295 19665 sys_catalog.cc:455] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c35d78a67778450d8fbe76e5514eb651. Latest consensus state: current_term: 1 leader_uuid: "c35d78a67778450d8fbe76e5514eb651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } } }
I20260808 23:39:20.010608 19665 sys_catalog.cc:458] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:39:20.012140 19681 sys_catalog.cc:455] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c35d78a67778450d8fbe76e5514eb651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } } }
I20260808 23:39:20.012503 19681 sys_catalog.cc:458] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [sys.catalog]: This master's current role is: LEADER
I20260808 23:39:20.013327 19704 catalog_manager.cc:1347] Generated new cluster ID: 675e6d05bed944c7b0a30b0519870ae3
I20260808 23:39:20.013527 19704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 23:39:20.021453 19649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c35d78a67778450d8fbe76e5514eb651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } } }
I20260808 23:39:20.021829 19649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:39:20.033761 19714 sys_catalog.cc:455] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c35d78a67778450d8fbe76e5514eb651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } } }
I20260808 23:39:20.034366 19714 sys_catalog.cc:458] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651 [sys.catalog]: This master's current role is: LEADER
I20260808 23:39:20.035143 19665 sys_catalog.cc:455] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c35d78a67778450d8fbe76e5514eb651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35d78a67778450d8fbe76e5514eb651" member_type: VOTER last_known_addr { host: "127.26.207.254" port: 40353 } } peers { permanent_uuid: "babe4adfe1ad437e806593b52d17fa11" member_type: VOTER last_known_addr { host: "127.26.207.253" port: 40355 } } peers { permanent_uuid: "2a1a9d0710ad472ba45e39f092eb5f20" member_type: VOTER last_known_addr { host: "127.26.207.252" port: 36565 } } }
I20260808 23:39:20.035414 19665 sys_catalog.cc:458] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 23:39:20.069200 19707 mvcc.cc:205] Tried to move back new op lower bound from 7316407746329239552 to 7316407745909157888. Current Snapshot: MvccSnapshot[applied={T|T < 7316407746329239552}]
I20260808 23:39:20.100481 19704 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 23:39:20.102710 19704 catalog_manager.cc:1504] Loading token signing keys...
I20260808 23:39:20.134351 19704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c35d78a67778450d8fbe76e5514eb651: Generated new TSK 0
I20260808 23:39:20.135790 19704 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 23:39:20.251977 19646 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:20.243574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33730 (local address 127.26.207.254:40353)
0808 23:39:20.244413 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.244422 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.249548 (+ 5126us) server_negotiation.cc:407] Connection header received
0808 23:39:20.249925 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.249932 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.250051 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.250151 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:20.251677 (+ 1526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33730: BlockingRecv error: recv got EOF from 127.0.0.1:33730 (error 108)
Metrics: {"server-negotiator.queue_time_us":622}
W20260808 23:39:20.254869 19569 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:20.243829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51560 (local address 127.26.207.253:40355)
0808 23:39:20.244689 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.244698 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.252375 (+ 7677us) server_negotiation.cc:407] Connection header received
0808 23:39:20.252948 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.252954 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.253050 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.253122 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:20.254590 (+ 1468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51560: BlockingRecv error: recv got EOF from 127.0.0.1:51560 (error 108)
Metrics: {"server-negotiator.queue_time_us":642}
W20260808 23:39:20.254853 19645 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:20.243316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47752 (local address 127.26.207.252:36565)
0808 23:39:20.244126 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.244136 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.251971 (+ 7835us) server_negotiation.cc:407] Connection header received
0808 23:39:20.252942 (+ 971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.252948 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.253044 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.253122 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:20.254590 (+ 1468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47752: BlockingRecv error: recv got EOF from 127.0.0.1:47752 (error 108)
Metrics: {"server-negotiator.queue_time_us":619}
W20260808 23:39:20.262869 19569 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:20.260180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51572 (local address 127.26.207.253:40355)
0808 23:39:20.260411 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.260417 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.261166 (+ 749us) server_negotiation.cc:407] Connection header received
0808 23:39:20.261443 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.261447 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.261576 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.261701 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:20.262530 (+ 829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51572: BlockingRecv error: recv got EOF from 127.0.0.1:51572 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
W20260808 23:39:20.270488 19569 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:20.268135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51584 (local address 127.26.207.253:40355)
0808 23:39:20.268387 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.268396 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.268954 (+ 558us) server_negotiation.cc:407] Connection header received
0808 23:39:20.269211 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.269217 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.269305 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.269433 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:20.270239 (+ 806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51584: BlockingRecv error: recv got EOF from 127.0.0.1:51584 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260808 23:39:20.278640 19569 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:20.276015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51588 (local address 127.26.207.253:40355)
0808 23:39:20.276266 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.276275 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.276959 (+ 684us) server_negotiation.cc:407] Connection header received
0808 23:39:20.277252 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.277260 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.277374 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.277504 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:20.278365 (+ 861us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51588: BlockingRecv error: recv got EOF from 127.0.0.1:51588 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260808 23:39:20.288453 19569 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:20.286018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51600 (local address 127.26.207.253:40355)
0808 23:39:20.286275 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.286284 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.286856 (+ 572us) server_negotiation.cc:407] Connection header received
0808 23:39:20.287102 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.287107 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.287193 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.287323 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:20.288174 (+ 851us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51600: BlockingRecv error: recv got EOF from 127.0.0.1:51600 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260808 23:39:20.302752 19569 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:20.300328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51614 (local address 127.26.207.253:40355)
0808 23:39:20.300580 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.300590 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.301188 (+ 598us) server_negotiation.cc:407] Connection header received
0808 23:39:20.301434 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.301441 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.301527 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.301648 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:20.302479 (+ 831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51614: BlockingRecv error: recv got EOF from 127.0.0.1:51614 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260808 23:39:20.332746 19569 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:20.330276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51628 (local address 127.26.207.253:40355)
0808 23:39:20.330513 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.330538 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.331103 (+ 565us) server_negotiation.cc:407] Connection header received
0808 23:39:20.331352 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.331357 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.331461 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.331595 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:20.332452 (+ 857us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51628: BlockingRecv error: recv got EOF from 127.0.0.1:51628 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260808 23:39:20.370694 19569 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:20.368594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51642 (local address 127.26.207.253:40355)
0808 23:39:20.368856 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.368865 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.369165 (+ 300us) server_negotiation.cc:407] Connection header received
0808 23:39:20.369340 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.369346 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.369458 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.369605 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:20.370390 (+ 785us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51642: BlockingRecv error: recv got EOF from 127.0.0.1:51642 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260808 23:39:20.445869 19569 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:20.443271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51650 (local address 127.26.207.253:40355)
0808 23:39:20.443584 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.443591 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.443958 (+ 367us) server_negotiation.cc:407] Connection header received
0808 23:39:20.444239 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.444244 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.444363 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.444483 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:20.445634 (+ 1151us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51650: BlockingRecv error: recv got EOF from 127.0.0.1:51650 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
W20260808 23:39:20.581212 19569 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 23:39:20.579053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51660 (local address 127.26.207.253:40355)
0808 23:39:20.579242 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.579247 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.579679 (+ 432us) server_negotiation.cc:407] Connection header received
0808 23:39:20.579855 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.579862 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.579970 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.580098 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 23:39:20.580929 (+ 831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51660: BlockingRecv error: recv got EOF from 127.0.0.1:51660 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 23:39:20.601536 19662 catalog_manager.cc:1259] Loaded cluster ID: 675e6d05bed944c7b0a30b0519870ae3
I20260808 23:39:20.601706 19662 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20: loading cluster ID for follower catalog manager: success
I20260808 23:39:20.605646 19662 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20: acquiring CA information for follower catalog manager: success
I20260808 23:39:20.607640 19662 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2a1a9d0710ad472ba45e39f092eb5f20: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 23:39:20.688426 19676 catalog_manager.cc:1259] Loaded cluster ID: 675e6d05bed944c7b0a30b0519870ae3
I20260808 23:39:20.688571 19676 catalog_manager.cc:1552] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11: loading cluster ID for follower catalog manager: success
I20260808 23:39:20.691434 19676 catalog_manager.cc:1574] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11: acquiring CA information for follower catalog manager: success
I20260808 23:39:20.693387 19676 catalog_manager.cc:1602] T 00000000000000000000000000000000 P babe4adfe1ad437e806593b52d17fa11: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 23:39:20.848307 19569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:20.841587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51672 (local address 127.26.207.253:40355)
0808 23:39:20.841848 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.841858 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.842468 (+ 610us) server_negotiation.cc:407] Connection header received
0808 23:39:20.842624 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.842628 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.842793 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.842943 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:39:20.843397 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:20.844159 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:20.845948 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:20.846400 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:20.846530 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:20.847109 (+ 579us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:39:20.847714 (+ 605us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:39:20.847838 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:20.847991 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 23:39:20.848074 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 23:39:20.861747 19785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:20.855280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47762 (local address 127.26.207.252:36565)
0808 23:39:20.856347 (+ 1067us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.856352 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.856368 (+ 16us) server_negotiation.cc:407] Connection header received
0808 23:39:20.856473 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.856477 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.856652 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.856892 (+ 240us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:39:20.857358 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:20.858126 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:20.859487 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:20.859890 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:20.860008 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:20.860551 (+ 543us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:39:20.861189 (+ 638us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:39:20.861309 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:20.861418 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 23:39:20.861495 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":965,"thread_start_us":859,"threads_started":1}
I20260808 23:39:20.883713 19569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:20.868736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51686 (local address 127.26.207.253:40355)
0808 23:39:20.869028 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.869038 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.876768 (+ 7730us) server_negotiation.cc:407] Connection header received
0808 23:39:20.877292 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.877301 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.877418 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.877529 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:39:20.878422 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:20.879578 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:20.881658 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:20.882118 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:20.882272 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:20.882813 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:39:20.882967 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:39:20.883081 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:20.883280 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 23:39:20.883390 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 23:39:20.885210 19785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:20.868998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47774 (local address 127.26.207.252:36565)
0808 23:39:20.869193 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.869202 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.878279 (+ 9077us) server_negotiation.cc:407] Connection header received
0808 23:39:20.878560 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.878567 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.878670 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.878783 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:39:20.879426 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:20.880365 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:20.882668 (+ 2303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:20.883167 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:20.883288 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:20.884342 (+ 1054us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:39:20.884468 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:39:20.884537 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:20.884772 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 23:39:20.884888 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 23:39:20.885572 19791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 23:39:20.868676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33738 (local address 127.26.207.254:40353)
0808 23:39:20.877656 (+ 8980us) server_negotiation.cc:206] Beginning negotiation
0808 23:39:20.877663 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 23:39:20.877682 (+ 19us) server_negotiation.cc:407] Connection header received
0808 23:39:20.877801 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 23:39:20.877808 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 23:39:20.878058 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 23:39:20.878267 (+ 209us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 23:39:20.879092 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:20.879986 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:20.882481 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 23:39:20.883131 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 23:39:20.883294 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 23:39:20.884191 (+ 897us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 23:39:20.884593 (+ 402us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 23:39:20.884724 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 23:39:20.885183 (+ 459us) server_negotiation.cc:299] Negotiation successful
0808 23:39:20.885271 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8845,"thread_start_us":8712,"threads_started":1}
I20260808 23:39:20.890604 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 19420
I20260808 23:39:20.891791 19483 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:39:21.006474 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 19420
I20260808 23:39:21.033535 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 19496
I20260808 23:39:21.034722 19559 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:39:21.148679 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 19496
I20260808 23:39:21.174525 27455 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu pid 19572
I20260808 23:39:21.175882 19636 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 23:39:21.289827 27455 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWgS6PY/build/asan/bin/kudu with pid 19572
2026-08-08T23:39:21Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5077 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10298 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (397414 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST